-- Logs begin at Sat 2022-08-06 21:13:00 UTC, end at Sat 2022-08-06 22:36:17 UTC. -- Aug 06 22:01:31.324789 dv-cinder-849846-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 22:01:31.333363 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 22:01:31 2022] *** Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: nodename: dv-cinder-849846-7-iscsi Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: machine: x86_64 Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: clock source: unix Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: pcre jit disabled Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: detected number of CPU cores: 4 Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: current working directory: / Aug 06 22:01:31.335335 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: detected binary path: /usr/bin/uwsgi-core Aug 06 22:01:31.335962 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: your processes number limit is 47680 Aug 06 22:01:31.335962 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: your memory page size is 4096 bytes Aug 06 22:01:31.335962 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: detected max file descriptor number: 2048 Aug 06 22:01:31.335962 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: lock engine: pthread robust mutexes Aug 06 22:01:31.335962 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: thunder lock: enabled Aug 06 22:01:31.335962 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 22:01:31.335962 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 22:01:31.374807 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: Python main interpreter initialized at 0x55e1fa51f9c0 Aug 06 22:01:31.374807 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: python threads support enabled Aug 06 22:01:31.374807 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: your server socket listen backlog is limited to 100 connections Aug 06 22:01:31.374807 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: your mercy for graceful operations on workers is 90 seconds Aug 06 22:01:31.375179 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 22:01:31.375256 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: *** Operational MODE: preforking *** Aug 06 22:01:31.375486 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: *** uWSGI is running in multiple interpreter mode *** Aug 06 22:01:31.375486 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: spawned uWSGI master process (pid: 103926) Aug 06 22:01:31.375685 dv-cinder-849846-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 22:01:31.376780 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: spawned uWSGI worker 1 (pid: 103927, cores: 1) Aug 06 22:01:31.376780 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: spawned uWSGI worker 2 (pid: 103928, cores: 1) Aug 06 22:01:31.376780 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 22:01:32.036811 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 22:01:32.037646 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 22:01:33.138345 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 22:01:33.138345 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: from cryptography.utils import int_from_bytes Aug 06 22:01:33.139031 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 22:01:33.139031 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: from cryptography.utils import int_from_bytes Aug 06 22:01:33.141918 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 22:01:33.141918 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: from cryptography.utils import int_from_bytes Aug 06 22:01:33.142340 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 22:01:33.142340 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: from cryptography.utils import int_from_bytes Aug 06 22:01:35.631896 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 22:01:35.632537 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 22:01:35.632537 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 22:01:35.632966 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 22:01:35.633049 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 22:01:35.633138 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 22:01:35.633224 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 22:01:35.633312 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 22:01:35.633398 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 22:01:35.633477 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 22:01:35.633559 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.633643 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.634417 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.634538 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.634735 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.634894 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.635133 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.635230 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.635464 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.635558 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.635774 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.635866 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.636094 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.636191 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.636423 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.636512 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.636755 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.636840 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.637014 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.637110 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.637324 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.637408 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.637644 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-7-iscsi {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.637728 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-7-iscsi {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.637959 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.638052 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.638261 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.638371 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.638564 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.638656 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.638879 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.638964 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.639181 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.639266 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.639498 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.639590 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.639798 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.639883 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.640289 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.640689 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.640829 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.640952 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.641066 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.641177 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.641308 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.641420 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.641642 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.641763 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.641949 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.642041 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.642254 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.642345 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.642571 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.642667 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.642873 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.642957 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.643190 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.643321 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.643493 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.643584 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.643879 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-7-iscsi {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.643972 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-7-iscsi {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.644191 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.644282 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.644525 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.644671 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.644833 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.644971 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.645240 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.645344 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.645546 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.645681 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.645850 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.645985 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.646164 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.646255 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.646484 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.646570 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.646787 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.646871 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.647103 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.647193 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.647416 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.647501 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.647731 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.647815 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.648045 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.648137 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.648339 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.648437 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.648665 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.648751 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.648969 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.649062 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.649282 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.649384 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.650203 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.650295 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.650508 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.650756 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.650848 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.651032 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.651126 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.651342 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.651435 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.651666 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.651758 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.651987 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.652084 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.652234 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.652330 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.652504 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.652593 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.652808 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.652905 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.653125 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.653221 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.653428 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.653520 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.653731 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.653825 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.654034 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.654120 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.654335 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.654425 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.654638 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.654746 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.654936 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.655029 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.655236 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.655326 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.655536 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.655629 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.655837 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.655923 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.656147 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.656237 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.656481 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.656585 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.656785 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.656870 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.657092 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.657182 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.657408 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.657506 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.657717 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.657809 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.658019 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.658105 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.658324 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.658415 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.658657 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.658741 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.658962 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.659054 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.659271 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.659356 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.659585 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.659670 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.659886 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.659971 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.660188 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.660275 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.660510 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.660596 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.660812 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.660895 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.661127 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.661221 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.661436 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.661527 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.661683 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.661777 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.661973 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.662067 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.662268 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.662355 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.662567 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.662661 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.662867 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.662951 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.663167 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.663251 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.663465 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.663557 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.663759 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.663852 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.664050 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.664135 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.664350 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.664497 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.664693 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.664838 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.664980 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.665113 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.665319 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.665439 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.665688 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.665786 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.665916 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.665998 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.666213 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.666300 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.666511 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.666596 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.666815 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.666906 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.667131 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.667224 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.667433 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.667519 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.667733 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.667816 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.668031 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.668117 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.668331 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.668443 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.668667 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.668796 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.668969 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.669061 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.669272 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.669358 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.669573 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.669665 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.669881 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.669967 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.670181 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.670274 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.670484 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.670569 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.670786 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.670871 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.671086 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.671173 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.671387 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.671471 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.671687 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.671773 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.671989 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.672074 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.672290 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.672374 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.672618 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.672712 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.672919 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.673005 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.673217 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.673315 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.673517 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.673609 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.673816 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.673899 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.674113 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.674206 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.674410 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.674494 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.674708 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.674851 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.675004 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.675107 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.675298 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.675392 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.675617 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.675702 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.675921 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.676015 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.676224 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.676316 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.676548 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.676637 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.676849 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.676936 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.677165 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:01:35.677306 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.677496 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.677589 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.677826 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.677913 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.678136 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.678219 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.678465 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.678548 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.678791 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.678876 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.679106 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.679199 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.679417 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.679613 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.679727 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.679813 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.680037 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.680121 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.680345 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.680484 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.680709 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.680823 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.681022 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.681112 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.681329 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.681423 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.681645 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.681730 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.681961 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.682061 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.682289 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.682388 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.682603 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.682706 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.682915 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.683000 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.683227 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.683322 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.683535 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.683621 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.683847 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.683939 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.684168 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.684265 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.684504 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.684594 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.684806 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.684946 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.685144 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.685240 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.685471 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.685555 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.685786 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.685871 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.686098 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.686191 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.686405 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.686491 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.686712 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.686803 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.687015 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.687107 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.687321 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.687413 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.687644 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.687737 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.687950 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.688042 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.688263 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.688350 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.688595 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.688693 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.688902 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.688995 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.689207 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.689292 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.689513 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.689608 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.689820 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.689907 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.690129 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.690223 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.690445 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.690539 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.690756 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.690842 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.691062 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.691148 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.691370 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.691470 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.691672 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.691758 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.691978 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.692062 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.692280 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.692374 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.692603 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.692693 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.692905 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.692988 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.693201 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.693287 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.693500 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.693585 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.693795 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.693880 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.694094 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.694187 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.694409 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.694496 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.694708 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.694792 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.695026 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.695111 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.695325 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.695409 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.695713 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.695933 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.696020 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.696238 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.696936 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.697083 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.697313 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.697501 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.697678 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.697869 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.697985 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.698289 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.698429 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.698614 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.698922 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.699015 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.699228 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.699548 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.699642 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.699858 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.700113 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.700199 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.700489 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.700714 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.700818 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.701094 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.701308 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.701402 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.701698 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.701888 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.702020 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.702308 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.702395 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.702627 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.702713 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.702946 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.703032 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.703455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.703548 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.703548 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.703700 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.703863 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.703947 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.704177 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.704265 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.704513 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.704601 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.704817 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.704905 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.705125 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.705213 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.705427 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.705521 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.705728 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.705814 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.706030 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.706116 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.706335 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.706428 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.706635 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.706720 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.706936 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.707030 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.707237 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.707331 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.707536 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.707622 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.707836 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.707920 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.708140 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.708234 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.708465 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.708566 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.708766 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.708852 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.709066 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.709193 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.709368 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.709453 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.709670 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.709763 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.709978 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.710099 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.710298 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.710391 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.710605 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.710694 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.710906 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.711005 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.711207 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.711304 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.711509 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.711606 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.711840 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.711930 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.712842 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.712952 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.713164 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.713360 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.713481 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.713702 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.713798 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.714022 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.714111 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.714346 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.714436 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.714663 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.714752 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.714978 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.715067 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.715291 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.715393 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.715598 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.715697 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.715908 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.715996 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.716208 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.716297 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.716547 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.716646 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.716854 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.716941 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.717172 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.717300 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.717479 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.717581 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.717801 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.717907 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.718108 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.718214 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.718418 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.718516 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.718718 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.718819 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.719025 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.719113 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.719336 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.719437 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.719649 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.719747 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.719969 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.720083 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.720275 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.720373 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.720608 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.720705 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.720913 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.720998 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.721219 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.721303 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.721527 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.721614 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.721833 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.721918 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.722131 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.722216 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.722441 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.722527 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.722747 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.722831 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.723064 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.723150 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.723371 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.723457 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.723676 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.723761 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.723982 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.724075 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.724289 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.724376 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.724616 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.724713 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.724922 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.725009 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.725224 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.725312 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.725526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.725620 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.725832 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.725931 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.726143 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.726229 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.726518 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.726616 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.726754 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.726850 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.727054 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.727141 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.727360 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.727444 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.727715 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.727883 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.728012 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.728099 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.728317 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.728432 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.728651 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.728755 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.728957 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.729043 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.729517 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.729611 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.729820 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.729914 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.730132 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.730225 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.730432 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.730517 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.730730 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.730816 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.731030 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.731117 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.731339 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.731425 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.731638 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.731731 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.731941 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.732027 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.732243 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.732329 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.732581 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.732668 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.732883 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.732989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.733183 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.733348 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.733503 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.733589 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.733806 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.733890 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.734105 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.734200 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.734405 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.734499 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.734709 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.734795 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.735014 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.735112 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.735333 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.735419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.735634 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.735737 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.735935 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.736029 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.736240 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.736327 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.736637 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.736737 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.736873 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.736960 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.737175 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.737260 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.737481 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.737566 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.737784 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.737877 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.738089 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.738182 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.738391 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.738475 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.738687 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.738773 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.738990 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.739074 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.739296 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.739390 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.739601 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.739864 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.739951 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.740191 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.740277 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.740596 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.740689 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.740905 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.740998 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.741207 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.741293 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.741511 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.741598 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.741823 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.741910 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.742144 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.742387 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.742481 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.742718 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.742814 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.743031 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.743142 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.743369 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.743578 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.743672 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.743984 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.744069 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.744298 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.744382 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.744629 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.744728 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.744934 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.745027 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.745239 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.745334 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.745548 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.745642 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.745852 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.745939 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.746152 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.746236 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.746451 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.746535 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.746757 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.746875 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.747057 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.747149 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.747353 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.747454 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.747656 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.747753 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.747954 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.748042 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.748252 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.748349 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.748580 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.748679 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.748878 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.748965 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.749176 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.749274 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.749475 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.749563 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.749784 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.749882 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.750082 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.750184 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.750402 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.750516 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.750705 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.750802 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.751005 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.751103 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.751302 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.751400 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.751601 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.751713 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.751935 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.752033 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.752237 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.752340 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.752570 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.752669 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.752869 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.752959 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.753173 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.753261 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.753477 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.753566 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.753775 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.753865 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.754081 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.754176 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.754385 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.754482 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.754690 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.754786 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.754989 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.755076 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.755285 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.755380 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.755587 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.755689 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.755885 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.755981 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.756188 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.756287 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.756515 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.756609 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.756815 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.756902 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.757115 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.757286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.757412 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.757499 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.757712 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.757798 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.758009 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.758104 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.758311 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.758405 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.758608 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.758696 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.759430 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.759527 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.759730 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.759946 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.760050 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.760251 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.760349 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.760591 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.760693 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.760899 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.760988 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.761206 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.761304 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.761509 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.761598 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.761808 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.761895 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.762109 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.762207 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.762409 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.762496 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.762709 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.762798 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.763013 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.763103 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.763310 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.763404 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.763607 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.763694 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.763912 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.764003 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.764211 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.764300 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.764532 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.764637 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.764845 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.764938 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.765146 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.765234 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.765442 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.765538 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.765743 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.765879 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.766043 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.766132 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.766347 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.766445 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.766644 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.766744 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.766942 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.767028 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.767239 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.767334 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.767537 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.767624 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.767833 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.767927 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.768138 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.768235 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.768455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.768546 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.768758 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.768848 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.769055 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.769150 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.769353 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.769446 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.769650 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.769737 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.769971 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.770062 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.770279 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.770375 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.770596 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.770738 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.770884 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.770974 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.771182 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.771278 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.771500 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.771594 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.771808 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.771905 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.772116 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.772212 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.772453 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.772559 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.772751 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.772841 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.773056 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.773151 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.773365 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.773463 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.773665 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.773753 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.773965 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.774053 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.774263 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.774359 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.775164 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.775311 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.775476 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.775572 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.775787 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.775887 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.776091 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.776190 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.776391 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.776540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.776735 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.776838 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.777041 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.777135 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.777348 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.777436 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.777651 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.777739 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.777955 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.778043 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.778262 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.778349 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.778564 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.778654 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.778870 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.778989 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.779176 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.779273 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.779480 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.779570 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.779784 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.779878 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.780087 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.780191 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.780390 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.780534 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.780718 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.780856 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.781019 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.781120 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.781325 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.781419 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.781631 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.781719 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.781929 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.782024 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.782232 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.782319 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.782530 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.782624 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.782828 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.782930 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.783127 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.783220 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.783441 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.783536 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.783742 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.783832 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.784047 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.784135 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.784347 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.784455 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.784678 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.784808 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.784982 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.785073 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.785345 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.785433 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.785653 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.785742 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.785954 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.786086 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.786278 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.786365 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.786584 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.786675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.786929 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.787024 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.787241 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.787329 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.787538 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.787627 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.787837 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.787924 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.788141 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.788241 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.788484 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.788577 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.788786 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.788888 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.789087 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.789185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.789387 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.789475 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.789705 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.789802 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.790040 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.790194 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.790380 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.790568 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.790795 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.790921 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.791103 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.791207 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.791405 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.791493 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.791759 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.791846 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.792061 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.792157 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.792381 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.792533 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.792731 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.792821 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.793050 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.793141 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.793368 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.793457 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.793670 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.793800 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.793980 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.794107 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.794286 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.794415 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.794608 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.794729 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.794929 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.795026 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.795242 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.795340 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.795552 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.795650 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.795854 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.795953 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.796174 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.796264 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.796515 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.796623 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.796827 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.796995 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.797145 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.797234 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.797454 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.797550 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.797752 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.797850 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.798069 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.798159 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.798385 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.798488 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.798693 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.798792 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.799008 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.799097 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.799354 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.799442 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.799662 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.799752 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.799963 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.800052 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.800264 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.800352 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.800610 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.800712 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.800912 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.801055 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.801219 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.801308 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.801524 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.801615 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.801822 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.801909 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.802121 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.802207 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.802421 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.802517 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.802726 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.802814 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.803026 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.803113 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.803329 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.803424 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.803631 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.803735 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.803932 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.804030 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.804229 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.804318 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.804566 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.804657 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.804870 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.804968 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.805182 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.805277 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.805483 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.805579 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.805870 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.805978 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.806271 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.806373 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.806494 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.806584 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.806812 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.806915 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.807115 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.807212 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.807417 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.807518 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.807717 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.807807 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.808015 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.808105 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.808352 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.808503 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.808678 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.808783 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.808995 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.809090 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.809308 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.809403 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.809632 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.809722 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.809933 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.810022 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.810232 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.810371 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.810538 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.810628 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.810837 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.810927 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.811139 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.811237 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.811436 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.811527 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.811739 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.811829 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.812037 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.812139 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.812336 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.812446 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.812660 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.812749 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.812962 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.813063 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.813265 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.813353 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.813572 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.813662 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.813872 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.813963 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.814169 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.814259 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.814468 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.814555 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.814763 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.814860 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.815084 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.815171 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.815398 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.815499 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.815699 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.815789 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.815998 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.816087 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.816299 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.816416 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.816622 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.816714 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.816940 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.817028 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.817247 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.817385 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.817555 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.817645 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.817864 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.817960 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.818172 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.818269 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.818491 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.818592 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.818781 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.818877 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.819089 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.819186 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.819397 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.819484 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.819704 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.819798 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.820017 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.820220 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.820331 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.820570 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.820663 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.820881 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.820983 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.821192 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.821797 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.822049 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.822219 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.822354 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.822662 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.822753 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.822973 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.823071 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.823280 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.823370 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.823586 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.823677 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.823895 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.823984 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.824209 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.824305 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.824548 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.824655 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.824868 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.824965 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.825179 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.825277 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.825488 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.825591 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.825799 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.825897 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.826109 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.826275 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.826421 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.826510 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.826745 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.826834 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.827074 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.827171 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.827376 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.827466 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.827690 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.827788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.827998 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.828088 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.828307 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.828395 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.828642 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.828743 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.828950 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.829048 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.829262 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.829357 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.829571 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.829667 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.829875 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.829971 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.830181 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.830271 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.830487 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.830633 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.830794 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.830883 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.831103 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.831192 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.831413 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.831505 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.831720 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.831810 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.832028 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.832116 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.832336 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.832451 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.832672 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.832762 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.832992 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.833185 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.833324 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.833496 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.833641 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.833823 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.833951 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.834145 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.834260 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.834463 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.834552 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.834774 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.835077 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.835179 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.835386 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.835475 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.835691 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.835780 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.835991 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.836089 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.836297 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.836394 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.836627 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.836729 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.837495 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.837642 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.837829 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.838000 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.838136 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.838366 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.838465 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.838674 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.838765 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.838983 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.839072 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.839294 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.839545 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.839643 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.839890 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.839988 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.840202 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.840296 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.840533 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.840677 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.840852 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.840943 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.841161 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.841249 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.841465 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.841689 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.841786 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.842030 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.842126 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.842343 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.842440 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.842666 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.842761 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.842977 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.843065 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.843278 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.843369 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.843580 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.843668 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.843884 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.843972 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.844192 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.844291 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.844515 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.844619 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.844824 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.844913 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.845127 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.845217 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.845426 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.845513 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.845729 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.845828 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.846030 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.846117 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.846331 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.846420 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.846630 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.846726 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.846927 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.847023 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.847224 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.847311 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.847521 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.847617 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.847822 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.847911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.848123 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.848219 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.848436 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.848540 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.848746 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.848836 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.849044 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.849131 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.849344 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.849441 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.849639 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.849726 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.849938 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.850029 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.850232 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.850321 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.850531 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.850626 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.850835 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.850931 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.851133 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.851222 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.851439 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.851575 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.851738 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.851828 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.852041 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.852137 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.852342 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.852445 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.852740 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.852850 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.853086 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.853177 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.853403 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.853517 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.853834 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.853934 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.854397 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.854493 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.854732 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.854821 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.855041 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.855144 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.855351 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.855440 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.855700 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.855807 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.856012 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.856183 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.856313 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.856567 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.856659 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.856900 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.857018 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.857219 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.857317 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.857543 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.857630 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.857849 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.857947 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.858156 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.858244 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.858457 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.858546 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.858760 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.858863 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.859063 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.859151 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.859368 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.859458 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.859672 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.859770 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.859976 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.860072 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.860280 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.860375 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.860610 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.860700 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.860914 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.861007 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.861220 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.861317 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.861525 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.861663 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.861831 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.861929 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.862136 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.862226 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.862444 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.862535 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.862749 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.862845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.863052 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.863148 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.863354 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.863442 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.863657 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.863751 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.863961 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.864059 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.864272 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.864361 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.864620 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.864721 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.864933 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.865030 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.865235 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.865322 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.865538 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.865632 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.865843 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.865949 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.866148 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.866252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.866453 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.866544 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.866761 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.866899 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.867086 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.867176 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.867393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.867483 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.867696 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.867794 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.868049 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.868191 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.868455 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.868569 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.868749 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.868838 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.869066 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.869164 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.869372 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.869471 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.869692 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.869782 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.869993 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.870082 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.870297 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.870395 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.870601 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.870692 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.870905 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.871002 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.871218 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.871314 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.871526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.871615 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.871829 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.871927 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.872126 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.872223 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.872451 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.872548 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.872752 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.872842 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.873052 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.873144 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.873351 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.873440 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.873650 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.873746 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.873954 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.874044 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.874251 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.874338 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.874549 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.874648 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.874851 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.874947 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.875148 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.875236 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.875444 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.875541 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.875740 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.875836 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.876040 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.876138 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.876333 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.876485 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.876652 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.876742 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.876950 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.877039 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.877247 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.877343 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.877542 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.877636 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.877837 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.877923 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.878133 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.878223 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.878435 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.878530 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.878731 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.878820 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.879029 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.879137 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.879325 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.879422 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.879621 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.879710 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.879917 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.880007 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.880243 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.880333 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.880592 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.880705 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.880902 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.880992 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.881218 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.881307 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.881525 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.881622 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.881833 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.881966 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.882135 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.882224 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.882441 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.882539 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.882747 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.882838 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.883053 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.883144 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.883355 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.883455 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.883683 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.884288 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.884542 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.884636 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.884870 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.884961 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.885183 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.885273 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.885499 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.885589 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.885811 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.885902 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.886117 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.886214 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.886440 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.886530 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.886746 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.886837 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.887050 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.887137 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.887352 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.887448 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.887659 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.887756 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.887962 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.888052 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.888272 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.888375 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.888603 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.888694 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.888907 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.888997 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.889220 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.889318 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.889525 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.889617 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.889827 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.889916 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.890134 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.890224 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.890440 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.890535 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.890751 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.890854 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.891057 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.891148 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.891364 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.891452 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.891676 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.891766 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.891991 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.892090 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.892313 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.892445 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.892658 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.892757 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.892965 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.893053 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.893263 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.893350 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.893504 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 22:01:35.893606 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.893932 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.894242 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.894588 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.894917 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.895231 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.895540 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.895841 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:01:35.896082 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 22:01:36.048367 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO dbcounter [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Registered counter for database nova_api Aug 06 22:01:36.051613 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO dbcounter [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Registered counter for database nova_api Aug 06 22:01:36.069601 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_db.sqlalchemy.engines [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:01:36.073364 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_db.sqlalchemy.engines [None req-96164938-111e-4fad-b240-0944cdf264ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:01:36.076107 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writer thread running {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:01:36.079868 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writer thread running {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:01:36.132641 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.context [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6d95ae6-742b-4bf4-9987-f8ad7d260984(cell1) {{(pid=103928) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 22:01:36.136662 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:36.137148 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:36.138722 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:36.139459 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:36.139908 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:36.141912 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:36.143645 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.context [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6d95ae6-742b-4bf4-9987-f8ad7d260984(cell1) {{(pid=103927) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 22:01:36.143884 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO dbcounter [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Registered counter for database nova_cell0 Aug 06 22:01:36.147534 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_concurrency.lockutils [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:36.147958 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_concurrency.lockutils [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:36.149291 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO dbcounter [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Registered counter for database nova_cell1 Aug 06 22:01:36.150075 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_concurrency.lockutils [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:36.150799 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_concurrency.lockutils [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:36.151239 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_concurrency.lockutils [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:36.153256 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_concurrency.lockutils [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:36.155281 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO dbcounter [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Registered counter for database nova_cell0 Aug 06 22:01:36.157460 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_db.sqlalchemy.engines [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:01:36.159172 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_db.sqlalchemy.engines [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:01:36.160964 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO dbcounter [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Registered counter for database nova_cell1 Aug 06 22:01:36.164201 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writer thread running {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:01:36.168112 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writer thread running {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:01:36.168765 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_db.sqlalchemy.engines [None req-96164938-111e-4fad-b240-0944cdf264ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:01:36.170853 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_db.sqlalchemy.engines [None req-96164938-111e-4fad-b240-0944cdf264ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:01:36.175821 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writer thread running {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:01:36.178556 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writer thread running {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:01:36.313263 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO dbcounter [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Registered counter for database nova_cell0 Aug 06 22:01:36.321476 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO dbcounter [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Registered counter for database nova_cell0 Aug 06 22:01:36.322389 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_db.sqlalchemy.engines [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:01:36.326847 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writer thread running {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:01:36.330550 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG oslo_db.sqlalchemy.engines [None req-96164938-111e-4fad-b240-0944cdf264ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:01:36.334814 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writer thread running {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:01:36.740331 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: WARNING keystonemiddleware.auth_token [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 22:01:36.748293 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: WARNING keystonemiddleware.auth_token [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 22:01:36.770586 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: WARNING keystonemiddleware.auth_token [None req-96164938-111e-4fad-b240-0944cdf264ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 22:01:36.778622 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: WARNING keystonemiddleware.auth_token [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 22:01:37.092172 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: WARNING keystonemiddleware.auth_token [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 22:01:37.098086 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: WARNING keystonemiddleware.auth_token [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 22:01:37.104444 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1fa51f9c0 pid: 103928 (default app) Aug 06 22:01:37.106572 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:37.107759 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001752 Aug 06 22:01:37.108175 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Sat Aug 6 22:01:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:01:37.125454 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: WARNING keystonemiddleware.auth_token [None req-96164938-111e-4fad-b240-0944cdf264ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 22:01:37.131517 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: WARNING keystonemiddleware.auth_token [None req-96164938-111e-4fad-b240-0944cdf264ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 22:01:37.137319 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1fa51f9c0 pid: 103927 (default app) Aug 06 22:02:55.730083 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:55.731466 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Aug 06 22:02:55.732017 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:02:55.744481 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writing DB stats nova_api:SELECT=3 {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:55.750129 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writing DB stats nova_cell1:SELECT=3 {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:55.750958 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writing DB stats nova_cell0:SELECT=3 {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:55.752293 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:56.621075 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-e9b3b14f-5de5-43fa-b444-88c4e9939ccc admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:56.653279 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-e9b3b14f-5de5-43fa-b444-88c4e9939ccc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913993 Aug 06 22:02:56.654020 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Aug 6 22:02:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:58.879233 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:58.880665 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-78c8f76a-3d60-421f-b88e-8608082f25c3 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Aug 06 22:02:58.881276 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:02:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:02:59.327571 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-4fb3fc9a-7d9e-4e0b-bab0-4d9f9c089cba admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:59.349605 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 22:02:59.349605 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: warnings.warn(msg) Aug 06 22:02:59.430371 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-4fb3fc9a-7d9e-4e0b-bab0-4d9f9c089cba admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.541048 Aug 06 22:02:59.430930 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:02:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:02:59.445547 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_api:SELECT=3 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:59.446403 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_cell1:SELECT=3 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:59.448016 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_cell0:SELECT=3 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:59.448777 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:59.653834 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-08ed14ae-9f31-4c20-8418-27772904a67c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:59.658204 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 22:02:59.658204 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: warnings.warn(msg) Aug 06 22:02:59.820839 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-08ed14ae-9f31-4c20-8418-27772904a67c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.381386 Aug 06 22:02:59.821763 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Aug 6 22:02:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:03:02.052428 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-4fb3fc9a-7d9e-4e0b-bab0-4d9f9c089cba admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:02.053549 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-4fb3fc9a-7d9e-4e0b-bab0-4d9f9c089cba admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 Aug 06 22:03:02.054172 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:02.711402 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-8510528d-af27-4dd4-b23e-f392d5f20061 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 512}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:02.731304 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 22:03:02.731304 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: warnings.warn(msg) Aug 06 22:03:02.883912 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-8510528d-af27-4dd4-b23e-f392d5f20061 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.823906 Aug 06 22:03:02.891540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:03:02.897563 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-77a9477e-7970-490f-b161-e6f3aa6b731d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:02.900958 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 22:03:02.900958 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: warnings.warn(msg) Aug 06 22:03:03.053105 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-77a9477e-7970-490f-b161-e6f3aa6b731d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159920 Aug 06 22:03:03.058602 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Aug 6 22:03:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:03:05.279193 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-8510528d-af27-4dd4-b23e-f392d5f20061 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:05.280764 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-8510528d-af27-4dd4-b23e-f392d5f20061 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Aug 06 22:03:05.281166 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:05.679224 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-d663d7a2-2ec8-4bce-8d25-9062e2f249c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:05.747451 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-d663d7a2-2ec8-4bce-8d25-9062e2f249c8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460157 Aug 06 22:03:05.748006 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 22:03:05.760744 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-c72173e9-e4ff-4993-8aa7-c7eaf323e5b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:05.859801 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-c72173e9-e4ff-4993-8aa7-c7eaf323e5b5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102759 Aug 06 22:03:05.860396 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Aug 6 22:03:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:03:08.071961 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-d663d7a2-2ec8-4bce-8d25-9062e2f249c8 admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:08.073036 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-d663d7a2-2ec8-4bce-8d25-9062e2f249c8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 06 22:03:08.073454 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:08.536651 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-c9c392c7-9603-4f43-b8c7-8cc8febc0ddb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:08.610317 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-c9c392c7-9603-4f43-b8c7-8cc8febc0ddb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531071 Aug 06 22:03:08.610984 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:03:08.623760 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-e5e6d1e4-a07a-496f-8108-a45f58571a57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:08.706624 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-e5e6d1e4-a07a-496f-8108-a45f58571a57 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086640 Aug 06 22:03:08.708450 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Aug 6 22:03:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:03:10.927364 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-c9c392c7-9603-4f43-b8c7-8cc8febc0ddb admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:10.928300 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-c9c392c7-9603-4f43-b8c7-8cc8febc0ddb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 06 22:03:10.928929 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:11.393597 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-91c424e9-54e7-41f4-b9cb-7e0d09db09bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:11.519237 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-91c424e9-54e7-41f4-b9cb-7e0d09db09bb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.583239 Aug 06 22:03:11.520323 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 22:03:11.532949 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-1f2c68d0-ad8c-472a-8cb6-36263328384c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:11.614166 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-1f2c68d0-ad8c-472a-8cb6-36263328384c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084108 Aug 06 22:03:11.615599 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Sat Aug 6 22:03:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:03:14.147679 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-91c424e9-54e7-41f4-b9cb-7e0d09db09bb admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:14.149053 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-91c424e9-54e7-41f4-b9cb-7e0d09db09bb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 06 22:03:14.149515 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:14.595317 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-a918c46e-4b4d-4d50-b949-e24b584346b6 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:14.620526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-a918c46e-4b4d-4d50-b949-e24b584346b6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.464578 Aug 06 22:03:14.621071 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Aug 6 22:03:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:03:17.290842 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-91c424e9-54e7-41f4-b9cb-7e0d09db09bb admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:17.291928 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-91c424e9-54e7-41f4-b9cb-7e0d09db09bb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 06 22:03:17.292375 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:17.717244 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-83f6e02f-4e15-4ae9-9e3c-a264ab4c7fb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "swap": 0}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:17.819221 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-83f6e02f-4e15-4ae9-9e3c-a264ab4c7fb3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.520237 Aug 06 22:03:17.819946 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 22:03:17.833147 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-421a4e76-9456-4ad0-a8de-c0214c0985d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:17.957980 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-421a4e76-9456-4ad0-a8de-c0214c0985d4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129116 Aug 06 22:03:17.958584 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Aug 6 22:03:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:03:20.121295 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-83f6e02f-4e15-4ae9-9e3c-a264ab4c7fb3 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:20.122337 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-83f6e02f-4e15-4ae9-9e3c-a264ab4c7fb3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 06 22:03:20.122847 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:20.525291 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-78f84394-81c8-4eeb-bc5c-e8a48b910a10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:20.610863 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-78f84394-81c8-4eeb-bc5c-e8a48b910a10 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.481841 Aug 06 22:03:20.611423 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:03:20.623762 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-356f48a6-258f-490e-909c-8d1daf2cefd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:20.709612 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-356f48a6-258f-490e-909c-8d1daf2cefd6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089511 Aug 06 22:03:20.710194 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Aug 6 22:03:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:03:22.992252 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-78f84394-81c8-4eeb-bc5c-e8a48b910a10 admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:22.993309 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-78f84394-81c8-4eeb-bc5c-e8a48b910a10 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 06 22:03:22.993708 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:23.461964 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-c186df5b-eee3-4683-861d-4942fc392f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "swap": 0, "disk": 40}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:23.559841 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-c186df5b-eee3-4683-861d-4942fc392f2c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.560133 Aug 06 22:03:23.560454 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 22:03:23.575906 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-1cb57c9b-cb5e-4eab-a76e-c3a47957d242 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:23.667715 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-1cb57c9b-cb5e-4eab-a76e-c3a47957d242 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098482 Aug 06 22:03:23.668175 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Aug 6 22:03:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:03:25.929074 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-c186df5b-eee3-4683-861d-4942fc392f2c admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:25.930101 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-c186df5b-eee3-4683-861d-4942fc392f2c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 06 22:03:25.930703 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:26.404667 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-eb4407ad-ee08-44cf-9b14-41b8b4e28f3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:26.414489 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:03:26.486534 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-eb4407ad-ee08-44cf-9b14-41b8b4e28f3b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.549489 Aug 06 22:03:26.491360 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:03:26.503515 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-6da28752-dd4b-4f7c-9cfc-7d36a0c3d01a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:26.586196 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-6da28752-dd4b-4f7c-9cfc-7d36a0c3d01a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088124 Aug 06 22:03:26.586842 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Aug 6 22:03:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:03:28.827519 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-eb4407ad-ee08-44cf-9b14-41b8b4e28f3b admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:28.829273 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-eb4407ad-ee08-44cf-9b14-41b8b4e28f3b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002180 Aug 06 22:03:28.829685 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:29.265344 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-b19adb97-b27d-4fec-a5e2-d645e64dc5b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:29.348075 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-b19adb97-b27d-4fec-a5e2-d645e64dc5b5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.511517 Aug 06 22:03:29.356234 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Sat Aug 6 22:03:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:03:29.363354 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-c56e6f5b-1284-4460-a708-1db5093bf4a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:29.475394 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-c56e6f5b-1284-4460-a708-1db5093bf4a4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115868 Aug 06 22:03:29.476910 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Sat Aug 6 22:03:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:03:49.191531 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-b19adb97-b27d-4fec-a5e2-d645e64dc5b5 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:49.192595 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-b19adb97-b27d-4fec-a5e2-d645e64dc5b5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 06 22:03:49.192993 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:03:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:49.582316 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-207fba5f-36f9-4098-bfd3-b548bd465e1e admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:49.601067 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-207fba5f-36f9-4098-bfd3-b548bd465e1e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402199 Aug 06 22:03:49.601652 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Aug 6 22:03:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:03:50.665694 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-b19adb97-b27d-4fec-a5e2-d645e64dc5b5 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:50.666702 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-b19adb97-b27d-4fec-a5e2-d645e64dc5b5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 06 22:03:50.667100 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:03:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:51.185416 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-56353ef4-4891-486b-85e3-b46e7bfc1e6d admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:51.192129 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.wsgi [None req-56353ef4-4891-486b-85e3-b46e7bfc1e6d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-56353ef4-4891-486b-85e3-b46e7bfc1e6d admin admin] Request method failure captured: Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Accept: application/json Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Accept-Encoding: gzip, deflate Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Connection: keep-alive Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Content-Length: 0 Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Host: 10.222.0.18 Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Openstack-Api-Version: compute 2.90 Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Openstack-System-Scope: None Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: User-Agent: python-novaclient Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Auth-Token: gAAAAABi7uVGBRzm62VlugEk9QZ68JQg02P4l84e36MFlbiKW7lAyZbI0JtjmksC1EarxXpk67V42ounUSrt6dmePVWwOORByK39QqXwl9Mp92Fg4imGyzkeo-haVr6irqK-ddmP36bI4ddMkfKy2vm1qh9kZcM4VoddxtM7jARY35bZ9OzmkeI Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Domain-Id: None Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Domain-Name: None Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Identity-Status: Confirmed Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Is-Admin-Project: True Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Domain-Id: default Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Domain-Name: Default Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Name: admin Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Role: reader,admin,member Aug 06 22:03:51.195419 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Roles: reader,admin,member Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c285ce4925f04fb5acce87c789a71e83", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant: admin Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant-Name: admin Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User: admin Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Domain-Id: default Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Domain-Name: Default Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Id: 6bb7ac25afcb4fcaba91aca891ca7fc9 Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Name: admin Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: method: > Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: exception: Flavor 42 could not be found. Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: action_args: {'id': '42'} Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:03:51.197118 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:51.198455 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.199979 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-56353ef4-4891-486b-85e3-b46e7bfc1e6d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103927) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:03:51.201357 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-56353ef4-4891-486b-85e3-b46e7bfc1e6d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392759 Aug 06 22:03:51.201357 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Aug 6 22:03:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 22:03:51.206794 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-e11cc0ea-abe5-4a5d-b695-741ed8597e85 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:51.210984 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:03:51.229928 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-e11cc0ea-abe5-4a5d-b695-741ed8597e85 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026949 Aug 06 22:03:51.230483 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Aug 6 22:03:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:03:51.240727 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-61821265-db19-4ac8-aea6-0d4fed9e6265 admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:51.264629 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-61821265-db19-4ac8-aea6-0d4fed9e6265 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027469 Aug 06 22:03:51.265161 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Aug 6 22:03:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:03:51.274736 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-6321142d-b819-4d24-9c16-b10c8dd82fc6 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:51.280766 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.wsgi [None req-6321142d-b819-4d24-9c16-b10c8dd82fc6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-6321142d-b819-4d24-9c16-b10c8dd82fc6 admin admin] Request method failure captured: Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Accept: application/json Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Accept-Encoding: gzip, deflate Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Connection: keep-alive Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Content-Length: 0 Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Host: 10.222.0.18 Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Openstack-Api-Version: compute 2.90 Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Openstack-System-Scope: None Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: User-Agent: python-novaclient Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Auth-Token: gAAAAABi7uVGBRzm62VlugEk9QZ68JQg02P4l84e36MFlbiKW7lAyZbI0JtjmksC1EarxXpk67V42ounUSrt6dmePVWwOORByK39QqXwl9Mp92Fg4imGyzkeo-haVr6irqK-ddmP36bI4ddMkfKy2vm1qh9kZcM4VoddxtM7jARY35bZ9OzmkeI Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Domain-Id: None Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Domain-Name: None Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Identity-Status: Confirmed Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Is-Admin-Project: True Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Domain-Id: default Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Domain-Name: Default Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Name: admin Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Role: reader,admin,member Aug 06 22:03:51.284006 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Roles: reader,admin,member Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c285ce4925f04fb5acce87c789a71e83", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant: admin Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant-Name: admin Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User: admin Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Domain-Id: default Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Domain-Name: Default Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Id: 6bb7ac25afcb4fcaba91aca891ca7fc9 Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Name: admin Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: method: > Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: exception: Flavor 42 could not be found. Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: action_args: {'id': '42'} Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:03:51.292252 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:51.293247 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:51.294526 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-6321142d-b819-4d24-9c16-b10c8dd82fc6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:03:51.295818 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-6321142d-b819-4d24-9c16-b10c8dd82fc6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014219 Aug 06 22:03:51.295818 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Aug 6 22:03:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 22:03:52.241812 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-61821265-db19-4ac8-aea6-0d4fed9e6265 admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:52.242825 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-61821265-db19-4ac8-aea6-0d4fed9e6265 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 06 22:03:52.243220 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:03:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:52.772827 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-f0be6f0e-9fb0-4210-83f4-a8550dfc7469 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.wsgi [None req-f0be6f0e-9fb0-4210-83f4-a8550dfc7469 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-f0be6f0e-9fb0-4210-83f4-a8550dfc7469 admin admin] Request method failure captured: Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Accept: application/json Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Accept-Encoding: gzip, deflate Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Connection: keep-alive Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Content-Length: 0 Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Host: 10.222.0.18 Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Openstack-Api-Version: compute 2.90 Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Openstack-System-Scope: None Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: User-Agent: python-novaclient Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Auth-Token: gAAAAABi7uVIaLtjzScxbwSSBtzofMjWx_GsdfunH8stXSwxb17CuqODvL8krNZWdTF-EdiADavyvS_0A76AyQedOKr_sRY--CG9m_c-W2Ggijuvw9KkoNUiucr8LnTq2JOBJDf2Dy1yHF9McQ2zGj8sKHBI3C5eDnY0GBPIeb0roOKbjPHOZ6g Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Domain-Id: None Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Domain-Name: None Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Identity-Status: Confirmed Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Is-Admin-Project: True Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Domain-Id: default Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Domain-Name: Default Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Name: admin Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Role: reader,admin,member Aug 06 22:03:52.788540 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Roles: reader,admin,member Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c285ce4925f04fb5acce87c789a71e83", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant: admin Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant-Name: admin Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User: admin Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Domain-Id: default Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Domain-Name: Default Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Id: 6bb7ac25afcb4fcaba91aca891ca7fc9 Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Name: admin Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: method: > Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: exception: Flavor 84 could not be found. Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: action_args: {'id': '84'} Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:03:52.790156 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:52.790926 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.791989 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-f0be6f0e-9fb0-4210-83f4-a8550dfc7469 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:03:52.793044 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-f0be6f0e-9fb0-4210-83f4-a8550dfc7469 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391489 Aug 06 22:03:52.793044 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Aug 6 22:03:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 22:03:52.793179 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-093e4edd-d650-483e-a914-035b770fdd18 admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:52.806624 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-093e4edd-d650-483e-a914-035b770fdd18 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019487 Aug 06 22:03:52.807138 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Aug 6 22:03:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:03:52.817124 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-80934fc6-0e4e-4a89-bb23-5e02b7533e8e admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:52.831838 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-80934fc6-0e4e-4a89-bb23-5e02b7533e8e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018851 Aug 06 22:03:52.832364 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Aug 6 22:03:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:03:52.841411 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-ae0ca74a-c663-46d4-9c1b-bc6233e63b60 admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:52.847244 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.wsgi [None req-ae0ca74a-c663-46d4-9c1b-bc6233e63b60 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-ae0ca74a-c663-46d4-9c1b-bc6233e63b60 admin admin] Request method failure captured: Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Accept: application/json Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Accept-Encoding: gzip, deflate Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Connection: keep-alive Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Content-Length: 0 Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Host: 10.222.0.18 Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Openstack-Api-Version: compute 2.90 Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Openstack-System-Scope: None Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: User-Agent: python-novaclient Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Auth-Token: gAAAAABi7uVIaLtjzScxbwSSBtzofMjWx_GsdfunH8stXSwxb17CuqODvL8krNZWdTF-EdiADavyvS_0A76AyQedOKr_sRY--CG9m_c-W2Ggijuvw9KkoNUiucr8LnTq2JOBJDf2Dy1yHF9McQ2zGj8sKHBI3C5eDnY0GBPIeb0roOKbjPHOZ6g Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Domain-Id: None Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Domain-Name: None Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Identity-Status: Confirmed Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Is-Admin-Project: True Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Domain-Id: default Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Domain-Name: Default Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Name: admin Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Role: reader,admin,member Aug 06 22:03:52.848788 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Roles: reader,admin,member Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c285ce4925f04fb5acce87c789a71e83", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant: admin Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant-Name: admin Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User: admin Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Domain-Id: default Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Domain-Name: Default Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Id: 6bb7ac25afcb4fcaba91aca891ca7fc9 Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Name: admin Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: method: > Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: exception: Flavor 84 could not be found. Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: action_args: {'id': '84'} Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:03:52.850393 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:52.851337 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:52.852911 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-ae0ca74a-c663-46d4-9c1b-bc6233e63b60 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103927) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:03:52.854402 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-ae0ca74a-c663-46d4-9c1b-bc6233e63b60 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012386 Aug 06 22:03:52.854402 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Aug 6 22:03:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 22:03:53.832420 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-80934fc6-0e4e-4a89-bb23-5e02b7533e8e admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:53.833435 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-80934fc6-0e4e-4a89-bb23-5e02b7533e8e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 06 22:03:53.833828 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:03:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:03:54.352263 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-64eecf71-2a09-4de9-aa10-40c070d7cac5 admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:54.358311 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.wsgi [None req-64eecf71-2a09-4de9-aa10-40c070d7cac5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-64eecf71-2a09-4de9-aa10-40c070d7cac5 admin admin] Request method failure captured: Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Accept: application/json Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Accept-Encoding: gzip, deflate Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Connection: keep-alive Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Content-Length: 0 Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Host: 10.222.0.18 Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Openstack-Api-Version: compute 2.90 Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Openstack-System-Scope: None Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: User-Agent: python-novaclient Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Auth-Token: gAAAAABi7uVJyfIzFBv2gxNI45IEfW4wexghLrMETjv49Tof3-lZ0eWq_9zWoQOS8bB8GW8PGTCMriIRxY584tyo464dwwpSXl-tdvSH8Q1H397vp_pW1Cl5z-zXOxGy9fBfwXOn64IyXaRDWY_h9H52HiV5K921jkwdS_fBUawtpDOxsEX1UxA Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Domain-Id: None Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Domain-Name: None Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Identity-Status: Confirmed Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Is-Admin-Project: True Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Domain-Id: default Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Domain-Name: Default Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Project-Name: admin Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Role: reader,admin,member Aug 06 22:03:54.359813 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Roles: reader,admin,member Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c285ce4925f04fb5acce87c789a71e83", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant: admin Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-Tenant-Name: admin Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User: admin Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Domain-Id: default Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Domain-Name: Default Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Id: 6bb7ac25afcb4fcaba91aca891ca7fc9 Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: X-User-Name: admin Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: method: > Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: exception: Flavor 451 could not be found. Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: action_args: {'id': '451'} Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:03:54.361185 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:54.362286 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.363651 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-64eecf71-2a09-4de9-aa10-40c070d7cac5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103927) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:03:54.365027 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-64eecf71-2a09-4de9-aa10-40c070d7cac5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388967 Aug 06 22:03:54.365027 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Aug 6 22:03:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 22:03:54.370961 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-771cd1ed-af69-4fab-afeb-b38da773c5ea admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:54.386778 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-771cd1ed-af69-4fab-afeb-b38da773c5ea admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019447 Aug 06 22:03:54.387310 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Aug 6 22:03:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:03:54.397357 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:54.412375 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018592 Aug 06 22:03:54.412915 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Aug 6 22:03:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:03:54.421954 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-d0e01333-e2e9-46fa-8302-7607c4bf32ac admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:54.427633 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.wsgi [None req-d0e01333-e2e9-46fa-8302-7607c4bf32ac admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-d0e01333-e2e9-46fa-8302-7607c4bf32ac admin admin] Request method failure captured: Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Accept: application/json Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Accept-Encoding: gzip, deflate Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Connection: keep-alive Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Content-Length: 0 Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Host: 10.222.0.18 Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Openstack-Api-Version: compute 2.90 Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Openstack-System-Scope: None Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: User-Agent: python-novaclient Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Auth-Token: gAAAAABi7uVJyfIzFBv2gxNI45IEfW4wexghLrMETjv49Tof3-lZ0eWq_9zWoQOS8bB8GW8PGTCMriIRxY584tyo464dwwpSXl-tdvSH8Q1H397vp_pW1Cl5z-zXOxGy9fBfwXOn64IyXaRDWY_h9H52HiV5K921jkwdS_fBUawtpDOxsEX1UxA Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Domain-Id: None Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Domain-Name: None Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Identity-Status: Confirmed Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Is-Admin-Project: True Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Domain-Id: default Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Domain-Name: Default Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Project-Name: admin Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Role: reader,admin,member Aug 06 22:03:54.429163 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Roles: reader,admin,member Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c285ce4925f04fb5acce87c789a71e83", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c285ce4925f04fb5acce87c789a71e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant: admin Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant-Id: c285ce4925f04fb5acce87c789a71e83 Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-Tenant-Name: admin Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User: admin Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Domain-Id: default Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Domain-Name: Default Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Id: 6bb7ac25afcb4fcaba91aca891ca7fc9 Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: X-User-Name: admin Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: method: > Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: exception: Flavor 451 could not be found. Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: action_args: {'id': '451'} Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:03:54.430845 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:54.431675 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: ERROR nova.api.openstack.wsgi Aug 06 22:03:54.432797 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-d0e01333-e2e9-46fa-8302-7607c4bf32ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:03:54.433817 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-d0e01333-e2e9-46fa-8302-7607c4bf32ac admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012142 Aug 06 22:03:54.433817 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Aug 6 22:03:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 22:03:55.403026 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:55.404033 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 06 22:03:55.404444 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:03:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:55.922930 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-6842c3d1-7377-407c-af99-ff2b9fbbb32e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:55.995096 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-6842c3d1-7377-407c-af99-ff2b9fbbb32e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.450863 Aug 06 22:03:55.995639 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Aug 6 22:03:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 22:03:56.958928 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:56.960069 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Aug 06 22:03:56.960476 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:03:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:57.478093 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-fde7c963-0e32-4d0f-81a2-1ecf0ebc338e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:57.559889 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-fde7c963-0e32-4d0f-81a2-1ecf0ebc338e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.460714 Aug 06 22:03:57.560483 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Aug 6 22:03:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:03:58.549157 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:03:58.550759 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002739 Aug 06 22:03:58.551152 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:03:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:59.068379 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-fdd35fc7-95ac-4335-a342-746da3caec87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:03:59.145866 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-fdd35fc7-95ac-4335-a342-746da3caec87 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.457960 Aug 06 22:03:59.146410 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Aug 6 22:03:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:04:00.121530 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:00.122533 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 06 22:04:00.122922 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:04:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:04:00.644191 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-49058903-5abe-4733-8554-4630305670c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:04:00.712298 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-49058903-5abe-4733-8554-4630305670c1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.450639 Aug 06 22:04:00.712883 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Aug 6 22:04:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:04:01.680301 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:01.681399 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 06 22:04:01.681789 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:04:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:04:02.203835 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-a9b8fd88-9b3d-412a-a64b-4c1dfedf1129 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:02.224606 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-a9b8fd88-9b3d-412a-a64b-4c1dfedf1129 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405105 Aug 06 22:04:02.225141 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Sat Aug 6 22:04:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:04:53.565019 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:53.566064 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-a3422708-c7c6-49f6-84b7-92f51161552d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 06 22:04:53.566466 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 6 22:04:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:04:53.577105 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:53.954941 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-cbc1899e-f74a-4c5e-b6d4-101018055357 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:53.974965 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-cbc1899e-f74a-4c5e-b6d4-101018055357 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402794 Aug 06 22:04:53.975497 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Sat Aug 6 22:04:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:04:53.999865 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-c3dbf820-cdf8-44a8-8179-c732001e3b17 admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:54.003443 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG dbcounter [-] [103927] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:54.008722 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-c3dbf820-cdf8-44a8-8179-c732001e3b17 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013156 Aug 06 22:04:54.009249 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Sat Aug 6 22:04:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:54.021023 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-59086563-a96d-4e69-91f6-50f30f76dbdf admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:54.028804 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-59086563-a96d-4e69-91f6-50f30f76dbdf admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011315 Aug 06 22:04:54.029546 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Sat Aug 6 22:04:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:04:54.041324 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:54.049668 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012254 Aug 06 22:04:54.050178 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Sat Aug 6 22:04:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:54.062588 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-b20bc7ce-3d98-4f8c-9259-3025d150300f admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:54.070254 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-b20bc7ce-3d98-4f8c-9259-3025d150300f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012041 Aug 06 22:04:54.070770 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Sat Aug 6 22:04:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:08:24.276628 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:08:24.277667 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 06 22:08:24.278057 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:08:24.418178 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_api:SELECT=6 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:08:24.575148 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-2e5e9665-1a2d-440c-a0bd-44b53b900e20 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:08:24.577517 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 22:08:24.577517 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: warnings.warn(msg) Aug 06 22:08:24.578646 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-2e5e9665-1a2d-440c-a0bd-44b53b900e20 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:08:24.579121 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-2e5e9665-1a2d-440c-a0bd-44b53b900e20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:08:24.579553 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-2e5e9665-1a2d-440c-a0bd-44b53b900e20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:08:24.580304 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-2e5e9665-1a2d-440c-a0bd-44b53b900e20 admin admin] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:08:24.580781 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-2e5e9665-1a2d-440c-a0bd-44b53b900e20 admin admin] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:08:24.581208 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-2e5e9665-1a2d-440c-a0bd-44b53b900e20 admin admin] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:08:24.616015 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-2e5e9665-1a2d-440c-a0bd-44b53b900e20 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199172 Aug 06 22:08:24.616522 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Aug 6 22:08:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:08:25.459864 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:08:25.460939 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 06 22:08:25.461333 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:08:25.651488 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-398bd9b0-a7e0-4fb8-a687-aa3e9faa5782 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:08:25.653918 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 22:08:25.653918 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: warnings.warn(msg) Aug 06 22:08:25.655017 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-398bd9b0-a7e0-4fb8-a687-aa3e9faa5782 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:08:25.655497 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-398bd9b0-a7e0-4fb8-a687-aa3e9faa5782 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:08:25.655915 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-398bd9b0-a7e0-4fb8-a687-aa3e9faa5782 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:08:25.656650 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-398bd9b0-a7e0-4fb8-a687-aa3e9faa5782 admin admin] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:08:25.657123 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-398bd9b0-a7e0-4fb8-a687-aa3e9faa5782 admin admin] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:08:25.657535 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-398bd9b0-a7e0-4fb8-a687-aa3e9faa5782 admin admin] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:08:25.676444 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-398bd9b0-a7e0-4fb8-a687-aa3e9faa5782 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077111 Aug 06 22:08:25.677544 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Aug 6 22:08:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:08:36.914052 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:08:36.915058 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 06 22:08:36.915450 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:08:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:08:37.059910 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_cell0:SELECT=4 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:08:37.060674 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_cell1:SELECT=4 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:08:37.061306 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG dbcounter [-] [103928] Writing DB stats nova_api:SELECT=8 {{(pid=103928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:08:37.109648 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-6c645bca-c69e-40d3-a658-bc7b4613fa62 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:08:37.111993 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 22:08:37.111993 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: warnings.warn(msg) Aug 06 22:08:37.113127 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-6c645bca-c69e-40d3-a658-bc7b4613fa62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:08:37.113685 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-6c645bca-c69e-40d3-a658-bc7b4613fa62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:08:37.114726 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-6c645bca-c69e-40d3-a658-bc7b4613fa62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:08:37.115545 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-6c645bca-c69e-40d3-a658-bc7b4613fa62 admin admin] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:08:37.115990 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-6c645bca-c69e-40d3-a658-bc7b4613fa62 admin admin] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:08:37.116427 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-6c645bca-c69e-40d3-a658-bc7b4613fa62 admin admin] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:08:37.141814 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-6c645bca-c69e-40d3-a658-bc7b4613fa62 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086364 Aug 06 22:08:37.142367 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Aug 6 22:08:37 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:08:37.964131 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: DEBUG nova.api.openstack.wsgi [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] Calling method '>' {{(pid=103927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:08:37.965164 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: INFO nova.api.openstack.requestlog [None req-c31dec21-cdbe-4d2c-84f0-1f942860360a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 06 22:08:37.965555 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: [pid: 103927|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Aug 6 22:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:08:38.153847 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG nova.api.openstack.wsgi [None req-1669ef2e-0b2e-4815-906b-0e5378df6a09 admin admin] Calling method '>' {{(pid=103928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:08:38.156241 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 22:08:38.156241 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: warnings.warn(msg) Aug 06 22:08:38.157517 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-1669ef2e-0b2e-4815-906b-0e5378df6a09 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:08:38.157984 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-1669ef2e-0b2e-4815-906b-0e5378df6a09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:08:38.158406 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-1669ef2e-0b2e-4815-906b-0e5378df6a09 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:08:38.159112 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-1669ef2e-0b2e-4815-906b-0e5378df6a09 admin admin] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:08:38.159552 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-1669ef2e-0b2e-4815-906b-0e5378df6a09 admin admin] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:08:38.159962 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: DEBUG oslo_concurrency.lockutils [None req-1669ef2e-0b2e-4815-906b-0e5378df6a09 admin admin] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:08:38.182189 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: INFO nova.api.openstack.requestlog [None req-1669ef2e-0b2e-4815-906b-0e5378df6a09 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080030 Aug 06 22:08:38.182663 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: [pid: 103928|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Aug 6 22:08:38 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:09:34.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: Sat Aug 6 22:09:34 2022 - graceful shutdown triggered... Aug 06 22:09:34.807614 dv-cinder-849846-7-iscsi devstack@n-api.service[103927]: Gracefully killing worker 1 (pid: 103927)... Aug 06 22:09:34.807239 dv-cinder-849846-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 06 22:09:34.808391 dv-cinder-849846-7-iscsi devstack@n-api.service[103928]: Gracefully killing worker 2 (pid: 103928)... Aug 06 22:09:35.808264 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: worker 1 buried after 1 seconds Aug 06 22:09:35.808860 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: worker 2 buried after 1 seconds Aug 06 22:09:35.808860 dv-cinder-849846-7-iscsi devstack@n-api.service[103926]: goodbye to uWSGI. Aug 06 22:09:35.809864 dv-cinder-849846-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 06 22:09:35.810412 dv-cinder-849846-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 06 22:09:35.813253 dv-cinder-849846-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 22:09:35.825671 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 22:09:35 2022] *** Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: nodename: dv-cinder-849846-7-iscsi Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: machine: x86_64 Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: clock source: unix Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: pcre jit disabled Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: detected number of CPU cores: 4 Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: current working directory: / Aug 06 22:09:35.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: detected binary path: /usr/bin/uwsgi-core Aug 06 22:09:35.828348 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: your processes number limit is 47680 Aug 06 22:09:35.828348 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: your memory page size is 4096 bytes Aug 06 22:09:35.828348 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: detected max file descriptor number: 2048 Aug 06 22:09:35.828348 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: lock engine: pthread robust mutexes Aug 06 22:09:35.828348 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: thunder lock: enabled Aug 06 22:09:35.828348 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 22:09:35.828348 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 22:09:35.869277 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: Python main interpreter initialized at 0x562ee26f89c0 Aug 06 22:09:35.869277 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: python threads support enabled Aug 06 22:09:35.869277 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: your server socket listen backlog is limited to 100 connections Aug 06 22:09:35.869277 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: your mercy for graceful operations on workers is 90 seconds Aug 06 22:09:35.869721 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 22:09:35.869721 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: *** Operational MODE: preforking *** Aug 06 22:09:35.870015 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: *** uWSGI is running in multiple interpreter mode *** Aug 06 22:09:35.870015 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: spawned uWSGI master process (pid: 118437) Aug 06 22:09:35.870228 dv-cinder-849846-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 22:09:35.872368 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: spawned uWSGI worker 1 (pid: 118456, cores: 1) Aug 06 22:09:35.872915 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: spawned uWSGI worker 2 (pid: 118457, cores: 1) Aug 06 22:09:35.873183 dv-cinder-849846-7-iscsi devstack@n-api.service[118437]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 22:09:36.549893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 22:09:36.552678 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 22:09:37.719805 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 22:09:37.719805 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: from cryptography.utils import int_from_bytes Aug 06 22:09:37.720761 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 22:09:37.720761 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: from cryptography.utils import int_from_bytes Aug 06 22:09:37.720761 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 22:09:37.720761 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: from cryptography.utils import int_from_bytes Aug 06 22:09:37.721302 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 22:09:37.721302 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: from cryptography.utils import int_from_bytes Aug 06 22:09:40.080820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 22:09:40.081362 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 22:09:40.081741 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 22:09:40.081842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 22:09:40.081919 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 22:09:40.081998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 22:09:40.082070 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 22:09:40.082152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 22:09:40.082231 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 22:09:40.082317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 22:09:40.082642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.082757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.082923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.083065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.083247 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.083356 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.083570 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.083678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.083851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.083962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.084165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.084284 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.084515 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.084665 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.084869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.084987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.085154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.085291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.085417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.085551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.085735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.085921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.086052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-7-iscsi {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.086252 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-7-iscsi {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.086406 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.086576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.086703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.086952 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.087096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.087222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.087335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.087543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.087707 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.087849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.087971 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.088159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.088292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.088479 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.094498 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.094737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.094737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.095106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.095295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.095467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.096163 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.096323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.096523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.096693 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.096851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.097010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.097170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.097340 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.097525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.097700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.097855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.098013 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.098265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.098430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.098583 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.098766 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.099043 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-7-iscsi {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.099198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-7-iscsi {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.099352 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.099509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.099663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.099819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.099971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.100211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.100419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.100595 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.100761 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.100913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.101058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.101202 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.101347 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.101754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.101921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.102074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.102220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.102365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.102523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.102678 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.102678 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.102981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.103710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.103882 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.104031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.104183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.104354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.104593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.104770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.104918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.105232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.105401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.105605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.105754 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.106009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.106170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.106325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.106489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.106635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.106797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.106951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.107106 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.107251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.107406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.107562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.107707 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.107857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.108014 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.108171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.108325 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.108495 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.108674 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.108829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.108988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.109134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.109287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.109432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.109583 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.109746 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.109906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.110076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.110280 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.110442 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.110589 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.110742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.110936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.113196 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.113855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.114029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.114287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.114454 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.114619 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.114774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.114922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.115068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.115245 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.115502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.115663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.115808 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.116006 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.116156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.116310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.116534 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.116534 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.116824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.116972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.117123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.117276 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.117552 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.117791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.117917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118038 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118515 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118862 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.118991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.119113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.119232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.119350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.119469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.119595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.119716 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.119830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.119947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.120068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.120179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.120331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.122908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.123077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.123245 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.123441 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.124085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.124247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.124553 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.124721 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.124721 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.125020 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.125167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.125331 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.125497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.125737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.125889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.126052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.126198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.126358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.126514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.126668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.126928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.127136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.127286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.127443 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.127601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.127747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.127906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.128059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.128222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.128434 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.128591 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.128771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.128922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.129067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.129222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.129384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.129537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.129689 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.129835 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.130630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.130791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.130946 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.131093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.131252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.131414 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.131414 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.131922 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.132077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.132371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.132607 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.132765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.132930 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.133090 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.133236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.133382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.133612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.134488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.134774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.134937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.135084 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.135245 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.135392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.135538 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.135691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.135986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.136139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.136298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.136475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.136635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.136794 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.136949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.137095 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.137253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.137406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.137559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.137711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.137862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.138019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.138178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.138331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.138477 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.138622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.138785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.138941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.139096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.139243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.139387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.139855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.140027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.140190 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.140355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.140593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.140757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.140906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.141060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.141220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.141374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.141532 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.141687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.141841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.141989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 22:09:40.142145 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.142299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.142482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.142643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.142791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.142947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.143102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.143256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.143403 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.143556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.143704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.143878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.144655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.144766 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.144853 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.144945 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145125 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145308 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145510 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145793 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.145967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146047 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146135 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146423 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146503 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.146968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147144 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147515 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147789 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.147891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.148063 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.148063 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.148227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.148227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.148391 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.151677 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.151781 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.151857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.151943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152131 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152637 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152740 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.152918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153003 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153194 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153281 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153553 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153639 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153819 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.153909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154002 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154088 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154344 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154423 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154564 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154647 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155017 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155350 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155711 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155895 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.155988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156079 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156325 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156431 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.156937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157118 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157394 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157487 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.157921 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.158007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.158637 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.158725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.158825 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.158913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.158985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159240 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.159950 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.160033 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.160124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.160209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.160209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.160385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.161173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.161299 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.161438 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.161532 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.161633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.161730 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.161817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.161912 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162007 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162337 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.162929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163266 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163351 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163526 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163896 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.163986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164611 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164692 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.164999 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165083 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165377 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165850 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.165943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166126 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166306 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166385 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166463 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.166924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167570 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167753 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.167938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168109 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168193 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168343 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168572 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168888 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.168982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169062 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169784 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.169974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170061 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170146 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170408 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170796 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170873 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.170952 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171256 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171636 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.171950 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172029 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172107 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.172990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.173074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.173157 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.173236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.173314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.173392 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.173476 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.173560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.173631 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.174773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.174853 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.174923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175084 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175157 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.175859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.176065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.176140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.176218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.176647 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.176744 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.176832 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.177040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.177134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.177463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.177556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.177630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.177717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.177898 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.178033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.178200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.178357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.178502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.178681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.178822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.178996 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.179129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.179317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.179431 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.179630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.179724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.179939 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.180089 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.180246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.180338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.180602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.180737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.180929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.181023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.181241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.181334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.181558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.181651 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.181866 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.181960 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.182168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.182260 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.182472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.182573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.182776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.182867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.183191 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.183395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.183496 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.183698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.183790 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.184001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.184108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.184303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.184397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.184637 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.184731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.184945 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.185048 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.185262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.185370 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.185568 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.185661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.185874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.185976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.186182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.186294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.186489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.186589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.186795 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.186896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.187111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.187215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.187421 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.187693 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.187796 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.188028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.188148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.188339 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.188493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.188683 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.188810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.188993 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.189095 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.189401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.189555 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.189877 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190010 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190010 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190442 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190538 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.190940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.191165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.191268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.191466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.191738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.191840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.192067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.192167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.192373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.192525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.192703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.192798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.193010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.193112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.193314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.193465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.193616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.193719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.193917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.194019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.194219 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.194312 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.194534 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.194638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.194838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.194943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.195147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.195277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.195450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.195544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.195769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.195868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.196072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.196178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.196374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.196547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.196782 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.196927 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.197017 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.197114 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.197308 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.197410 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.197615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.197748 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.197922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.198035 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.198228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.198323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.198546 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.198640 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.198856 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.198952 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.199168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.199262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.199472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.199565 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.199776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.199870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.200079 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.200173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.200378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.200509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.200706 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.200801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.201007 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.201107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.201308 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.201412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.201616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.201709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.201923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.202016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.202230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.202337 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.202536 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.202666 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.202834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.202936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.203139 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.203243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.203441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.203542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.203752 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.203845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.204051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.204188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.204350 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.204461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.204681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.204781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.205012 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.205140 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.205334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.205479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.205600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.205765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.205908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.206076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.206209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.206385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.206514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.206694 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.206819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.206997 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.207132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.207304 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.207405 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.207609 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.207712 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.207923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.208024 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.208230 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.208323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.208555 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.208651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.208864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.208969 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.209175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.209277 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.209476 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.209569 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.209774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.209874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.210072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.210171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.210371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.210470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.210675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.210767 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.210975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.211067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.211277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.211380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.211579 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.211670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.211884 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.212056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.212184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.212275 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.212506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.212614 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.212811 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.212914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.213117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.213212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.213417 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.213510 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.213714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.213819 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.214014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.214116 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.214313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.214413 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.214612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.214714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.214917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.215015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.215220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.215320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.215525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.215631 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.215824 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.215920 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.216123 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.216218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.216436 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.216531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.216742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.216849 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.217044 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.217136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.217349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.217455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.217650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.217743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.217949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.218041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.218248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.218341 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.218550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.218645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.218857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.218959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.219176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.219277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.219478 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.219571 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.219783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.219889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.220083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.220176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.220382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.221254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.221365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.221464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.221553 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.221758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.221860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.222109 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.222211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.222413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.222514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.222728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.222831 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.223045 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.223139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.223348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.223451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.223653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.223744 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.223956 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.224058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.224253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.224344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.224583 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.224677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.224892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.225002 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.225197 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.225298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.225496 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.225650 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.225790 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.225924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.226094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.226222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.226647 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.226798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.226958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.227063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.227267 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.227413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.227575 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.227684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.227877 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.227992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.228178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.228279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.228506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.228620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.228809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.228904 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.229112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.229209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.229412 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.229505 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.229717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.229826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.230016 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.230118 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.230323 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.230449 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.230627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.230758 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.230935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.231065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.231243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.231348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.231550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.231644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.231857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.231959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.232165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.232274 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.232489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.232588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.232814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.232908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.233121 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.233242 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.233423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.233543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.233727 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.233854 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.234028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.234163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.234336 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.234466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.234638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.234767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.235066 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.235171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.235377 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.235513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.235794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.235892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.235984 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.236065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.236969 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.237142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.237259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.237352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.237492 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.237584 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.237798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.237901 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.238102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.238303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.238519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.238616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.238831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.238933 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.239139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.239315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.239454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.239628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.239756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.239939 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.240042 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.240261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.240365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.240607 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.240704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.240931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.241026 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.241237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.241333 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.241552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.241647 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.241864 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.241961 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.242164 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.242259 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.242483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.242586 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.242792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.242895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.243105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.243212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.243409 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.243520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.243732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.243877 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.244052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.244185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.244364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.244505 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.244709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.244805 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.245121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.245235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.245437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.245540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.245743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.245918 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.246059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.246185 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.246370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.246495 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.246669 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.246772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.246987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.247088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.247285 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.247420 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.247615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.247731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.247885 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.247979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.248204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.248307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.248529 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.248641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.248840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.248943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.249148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.249250 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.249455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.249550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.249755 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.249858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.250056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.250162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.250373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.250467 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.250673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.250766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.250992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.251093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.251303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.251406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.251623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.251731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.251973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.252074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.252279 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.252382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.252696 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.252800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.253006 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.253100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.253312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.253433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.253616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.253720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.253917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.254024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.254219 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.254320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.254523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.254631 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.254842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.254936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.255143 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.255244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.255465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.255560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.255773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.255910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.256089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.256181 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.256426 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.256538 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.256738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.256831 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.257057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.257151 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.257367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.257480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.257683 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.257816 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.257957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.258054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.258257 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.258359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.258558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.258657 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.258859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.258966 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.259163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.259264 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.259469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.259565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.259771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.259874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.260073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.260168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.260372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.260485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.260716 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.260823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.261019 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.261122 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.261337 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.261439 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.261646 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.261754 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.261949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.262051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.262252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.262355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.262555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.262657 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.262858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.262952 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.263163 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.263264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.263472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.263608 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.263782 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.263880 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.264088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.264196 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.264390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.264533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.264713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.264822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.265030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.265130 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.265330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.265432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.265644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.265738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.265952 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.266076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.266270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.266387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.266556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.266651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.266858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.266970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.267176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.267306 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.267571 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.267747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.268054 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.268206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.268360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.268485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.268723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.268826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.269025 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.269133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.269342 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.269444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.269663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.269758 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.269974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.270069 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.270284 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.270388 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.270592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.270687 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.270901 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.270997 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.271208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.271307 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.271522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.271623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.271837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.271932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.272154 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.272250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.272509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.272705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.272826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.273034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.273135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.273349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.273452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.273661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.273764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.273980 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.274102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.274293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.274411 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.274604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.274708 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.274914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.275019 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.275225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.275341 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.275533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.275645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.275841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.275945 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.276146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.276259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.276492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.276604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.276806 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.276902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.277121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.277228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.277428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.277523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.277740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.277851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.278124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.278229 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.278362 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.278457 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.278691 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.278783 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.279008 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.279112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.279311 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.279411 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.279620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.279726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.279931 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.280030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.280243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.280468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.280567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.280781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.280877 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.281111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.281205 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.281432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.281530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.281754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.281857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.282059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.282150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.282368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.282476 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.282680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.282773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.282980 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.283586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.283855 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.283964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.284236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.284333 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.284587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.284681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.284894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.285008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.285210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.285312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.285517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.285733 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.285827 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.286092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.286208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.286380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.286500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.286708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.286936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.287034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.287283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.287378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.287606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.287701 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.287932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.288035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.288239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.288364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.288569 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.288678 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.288880 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.288986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.289185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.289279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.289491 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.289587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.289793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.289896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.290107 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.290203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.290406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.290514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.290707 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.290800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.291011 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.291107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.291321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.291541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.291639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.291889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.291983 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.292205 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.292300 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.292536 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.292634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.292861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.292957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.293167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.293339 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.293471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.293582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.293834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.293936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.294081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.294187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.294383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.294485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.294684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.294778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.294988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.295091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.295290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.295384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.295594 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.295698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.295893 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.296000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.296213 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.296328 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.296520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.296636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.296830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.296942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.297127 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.297221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.297438 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.297533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.297742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.297868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.298043 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.298147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.298347 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.298458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.298702 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.298896 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.299031 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.299146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.299323 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.299432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.299629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.299730 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.299938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.300032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.300251 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.300348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.300579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.300684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.300889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.300991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.301194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.301463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.301568 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.301792 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.301885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.302098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.302201 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.302401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.302504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.302720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.302815 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.303022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.303118 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.303323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.303419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.303626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.303729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.303949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.304052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.304258 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.304361 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.304593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.304697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.304900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.305005 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.305209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.305327 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.305517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.305614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.305824 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.306056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.306160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.306392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.306507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.306713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.306859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.307015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.307111 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.307323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.307420 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.307636 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.307856 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.308004 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.308100 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.308232 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.308336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.308571 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.308728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.308878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.308974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.309187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.309283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.309497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.309609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.309805 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.309915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.310115 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.310224 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.310423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.310518 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.310729 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.310832 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.311032 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.311128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.311338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.311443 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.311641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.311736 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.311948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.312060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.312259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.312364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.312589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.312694 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.312899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.313023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.313212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.313323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.313551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.313651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.313868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.313976 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.314182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.314820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.315046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.315164 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.315364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.315488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.315665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.315769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.315972 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.316067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.316281 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.316532 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.316674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.316803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.316941 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.317034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.317270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.317378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.317592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.317690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.317899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.318044 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.318211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.318318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.318525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.318752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.318921 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.319085 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.319262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.319423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.319581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.319749 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.319913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.320082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.320228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.320443 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.320622 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.320770 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.320926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.321082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.321232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.321550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.321692 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.321837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.321970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.322107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.322224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.322366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.322494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.322627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.322861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.322981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.323116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.323248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.323375 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.323498 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.323624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.323759 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.323885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.324029 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.324204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.324323 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.324492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.324616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.324760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.324913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.325043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.325181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.325318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.325458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.325586 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.325713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.325834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.326000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.326154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.326275 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.326402 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.326573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.326723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.326880 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.327148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.327235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.327308 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.327380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.327460 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.327543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.327858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.328161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.328255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.328351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.328472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.328575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.328670 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.328757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.328959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.329056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.329268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.329372 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.329576 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.329687 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.329902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.330526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.330787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.331114 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.331114 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.331397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.331490 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.331579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.331705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.331812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.332029 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.332124 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.332332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.332500 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.332676 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.332778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.332989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.333093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.333307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.333415 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.333621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.333728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.333929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.334028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.334257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.334435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.334592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.334742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.334886 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.335037 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.335177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.335328 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.335479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.335629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.335793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.335948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.336101 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.336244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.336383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.336525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.336626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.336763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.336940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.337036 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.337256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.337363 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.337579 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.337683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.337895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.337989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.338207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.338340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.338514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.338620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.338840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.338942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.339148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.339243 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.339459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.339563 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.339768 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.339863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.340077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.340171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.340384 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.340543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.340722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.340816 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.341030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.341159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.341269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 22:09:40.341364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.341637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.341953 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.342280 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.342606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.342917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.343243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.343567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.343918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.344231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.344601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.344933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.345252 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.349345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.349345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 22:09:40.349345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 22:09:40.494655 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO dbcounter [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Registered counter for database nova_api Aug 06 22:09:40.498522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO dbcounter [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Registered counter for database nova_api Aug 06 22:09:40.515142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_db.sqlalchemy.engines [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:09:40.519893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_db.sqlalchemy.engines [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:09:40.523099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writer thread running {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:09:40.526474 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writer thread running {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:09:40.581360 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.context [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6d95ae6-742b-4bf4-9987-f8ad7d260984(cell1) {{(pid=118456) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 22:09:40.583820 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.context [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6d95ae6-742b-4bf4-9987-f8ad7d260984(cell1) {{(pid=118457) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 22:09:40.585330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:40.586685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:40.587337 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:40.587812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:40.588060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:40.588282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:40.588527 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:40.589859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:40.590483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:40.590579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:40.591019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:40.592450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO dbcounter [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Registered counter for database nova_cell0 Aug 06 22:09:40.592995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:40.594969 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO dbcounter [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Registered counter for database nova_cell0 Aug 06 22:09:40.597336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO dbcounter [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Registered counter for database nova_cell1 Aug 06 22:09:40.599773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO dbcounter [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Registered counter for database nova_cell1 Aug 06 22:09:40.607128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_db.sqlalchemy.engines [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:09:40.608163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_db.sqlalchemy.engines [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:09:40.608781 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_db.sqlalchemy.engines [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:09:40.611184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_db.sqlalchemy.engines [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:09:40.615915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writer thread running {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:09:40.616302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writer thread running {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:09:40.616694 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writer thread running {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:09:40.618914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writer thread running {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:09:40.762254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO dbcounter [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Registered counter for database nova_cell0 Aug 06 22:09:40.763561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO dbcounter [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Registered counter for database nova_cell0 Aug 06 22:09:40.770061 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_db.sqlalchemy.engines [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:09:40.771763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_db.sqlalchemy.engines [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 22:09:40.775497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writer thread running {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:09:40.776508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writer thread running {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 22:09:41.092507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: WARNING keystonemiddleware.auth_token [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 22:09:41.099697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: WARNING keystonemiddleware.auth_token [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 22:09:41.100781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: WARNING keystonemiddleware.auth_token [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 22:09:41.107642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: WARNING keystonemiddleware.auth_token [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 22:09:41.442283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: WARNING keystonemiddleware.auth_token [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 22:09:41.448231 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: WARNING keystonemiddleware.auth_token [None req-5c76ecfa-d8f4-4f87-ac59-0bc38f6ac18b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 22:09:41.450547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: WARNING keystonemiddleware.auth_token [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 22:09:41.454379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ee26f89c0 pid: 118456 (default app) Aug 06 22:09:41.457183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: WARNING keystonemiddleware.auth_token [None req-f42a66f1-eb04-4940-bb62-5030991e4292 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 22:09:41.463270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ee26f89c0 pid: 118457 (default app) Aug 06 22:10:17.256497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=3 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:17.257973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=3 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:17.258931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=3 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:17.259848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=3 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:17.597496 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:17.599478 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:17.600715 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:17.602158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:18.667846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-55bb6770-b51f-483e-a3ea-c425acd3369a tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Action: 'create', calling method: .version_select at 0x7f30c8989dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-941979063", "metadata": {"Type": "work"}}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:19.224433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cac8e176-6286-45f9-889a-1e94e78645c9 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Action: 'create', calling method: .version_select at 0x7f30c898adc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-159764813", "metadata": {"Type": "work"}}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cac8e176-6286-45f9-889a-1e94e78645c9 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Request method failure captured: Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 121 Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubJddWP6uJBh0JVtQdekIkCQAWGNhoFqmUqZ6E5bsOeD-edFpGOe2Xfx9RPaOOTp8mEWTd5DhkjcVOFeDOEgKzqmwxVTjSE4n2mw1Yuv8xSirArx7276lIEy_EwEasePCZACe_YmzRA78a4GQX2IL9jqa40LZyLUjoRSx1nylGkl1Q Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:10:19.263148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd591617d7554c23b925b2372ead2475", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd591617d7554c23b925b2372ead2475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 69f6e7250ac24151ada8cd4bdde3e070 Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-159764813", "metadata": {"Type": "work"}}} Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: Aug 06 22:10:19.264876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-159764813', 'metadata': {'Type': 'work'}}}} Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise error Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi '#$%' Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:10:19.266410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 22:10:19.268194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 22:10:19.269597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 22:10:19.269597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.270641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cac8e176-6286-45f9-889a-1e94e78645c9 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:10:19.271629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cac8e176-6286-45f9-889a-1e94e78645c9 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.689955 Aug 06 22:10:19.278971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 6 22:10:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1701 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:10:19.294825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-61729be3-547b-4221-993d-1e0911fdcc33 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Action: 'create', calling method: .version_select at 0x7f30c88988b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1265142132", "metadata": {"Type": "work"}}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-61729be3-547b-4221-993d-1e0911fdcc33 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Request method failure captured: Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 120 Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubJddWP6uJBh0JVtQdekIkCQAWGNhoFqmUqZ6E5bsOeD-edFpGOe2Xfx9RPaOOTp8mEWTd5DhkjcVOFeDOEgKzqmwxVTjSE4n2mw1Yuv8xSirArx7276lIEy_EwEasePCZACe_YmzRA78a4GQX2IL9jqa40LZyLUjoRSx1nylGkl1Q Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:10:19.298575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd591617d7554c23b925b2372ead2475", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd591617d7554c23b925b2372ead2475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 69f6e7250ac24151ada8cd4bdde3e070 Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1265142132", "metadata": {"Type": "work"}}} Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: Aug 06 22:10:19.300169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1265142132', 'metadata': {'Type': 'work'}}}} Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise error Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi '0' Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:10:19.301201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 22:10:19.302688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 22:10:19.303800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 22:10:19.303800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.303800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-61729be3-547b-4221-993d-1e0911fdcc33 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:10:19.303800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-61729be3-547b-4221-993d-1e0911fdcc33 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017269 Aug 06 22:10:19.303800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 6 22:10:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-23f30d52-3055-420d-b0cf-1255106d5bf3 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Action: 'create', calling method: .version_select at 0x7f30c8845940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1183775112", "metadata": {"Type": "work"}}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-23f30d52-3055-420d-b0cf-1255106d5bf3 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Request method failure captured: Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 119 Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubJddWP6uJBh0JVtQdekIkCQAWGNhoFqmUqZ6E5bsOeD-edFpGOe2Xfx9RPaOOTp8mEWTd5DhkjcVOFeDOEgKzqmwxVTjSE4n2mw1Yuv8xSirArx7276lIEy_EwEasePCZACe_YmzRA78a4GQX2IL9jqa40LZyLUjoRSx1nylGkl1Q Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:10:19.326189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd591617d7554c23b925b2372ead2475", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd591617d7554c23b925b2372ead2475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 69f6e7250ac24151ada8cd4bdde3e070 Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1183775112", "metadata": {"Type": "work"}}} Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: Aug 06 22:10:19.327542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1183775112', 'metadata': {'Type': 'work'}}}} Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise error Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi '' Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:10:19.328857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 22:10:19.330273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 22:10:19.332437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 22:10:19.332437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:19.332437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-23f30d52-3055-420d-b0cf-1255106d5bf3 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:10:19.332437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-23f30d52-3055-420d-b0cf-1255106d5bf3 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008671 Aug 06 22:10:19.332437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 6 22:10:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:10:19.334769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-93598c34-53f6-47c0-872c-e485e8ca6187 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Calling method '.version_select at 0x7f30c8845670>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-93598c34-53f6-47c0-872c-e485e8ca6187 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] HTTP exception thrown: Volume tempest-invalid-1573500701 could not be found. Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-93598c34-53f6-47c0-872c-e485e8ca6187 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Request method failure captured: Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1573500701 HTTP/1.1 Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubJddWP6uJBh0JVtQdekIkCQAWGNhoFqmUqZ6E5bsOeD-edFpGOe2Xfx9RPaOOTp8mEWTd5DhkjcVOFeDOEgKzqmwxVTjSE4n2mw1Yuv8xSirArx7276lIEy_EwEasePCZACe_YmzRA78a4GQX2IL9jqa40LZyLUjoRSx1nylGkl1Q Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:10:20.592215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd591617d7554c23b925b2372ead2475", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd591617d7554c23b925b2372ead2475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 69f6e7250ac24151ada8cd4bdde3e070 Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Volume tempest-invalid-1573500701 could not be found. Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': 'tempest-invalid-1573500701'} Aug 06 22:10:20.606064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1573500701 could not be found. (HTTP 404) (Request-ID: req-9ad79d69-4024-476b-9d2c-e76e303742a5) Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.609842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 22:10:20.614736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1573500701 could not be found. Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:10:20.620022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1573500701 could not be found. Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1573500701 could not be found. Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-93598c34-53f6-47c0-872c-e485e8ca6187 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Returning 404 to user: Volume tempest-invalid-1573500701 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-93598c34-53f6-47c0-872c-e485e8ca6187 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1573500701" status: 404 len: 99 microversion: 2.1 time: 1.052091 Aug 06 22:10:20.622736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 4/4] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Aug 6 22:10:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1573500701 => generated 99 bytes in 1053 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 22:10:20.626563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-354ddc06-debc-455b-84df-9bf6fd44c3cf tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009652 Aug 06 22:10:20.626563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1140 bytes} [Sat Aug 6 22:10:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 22:10:20.626563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3f437d44-5e56-4dcd-83a5-76b64d17d171 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004667 Aug 06 22:10:20.626563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1137 bytes} [Sat Aug 6 22:10:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 22:10:20.626563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1db9dbcb-36ac-468f-9d62-fc7d02afb57f tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Calling method '.version_select at 0x7f30c8795ca0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:20.694729 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-55bb6770-b51f-483e-a3ea-c425acd3369a tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.448204 Aug 06 22:10:20.695598 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 1/7] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 6 22:10:17 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3450 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 06 22:10:20.709745 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c5566865-0ca7-4f6c-b753-d6b62cb097b9 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Calling method '.version_select at 0x7f30c887bc10>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:20.713988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-1db9dbcb-36ac-468f-9d62-fc7d02afb57f tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] HTTP exception thrown: Volume 2e724bfb-50bf-4846-b19f-33de2d5ba762 could not be found. Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1db9dbcb-36ac-468f-9d62-fc7d02afb57f tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Request method failure captured: Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/os-volumes/2e724bfb-50bf-4846-b19f-33de2d5ba762 HTTP/1.1 Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubJddWP6uJBh0JVtQdekIkCQAWGNhoFqmUqZ6E5bsOeD-edFpGOe2Xfx9RPaOOTp8mEWTd5DhkjcVOFeDOEgKzqmwxVTjSE4n2mw1Yuv8xSirArx7276lIEy_EwEasePCZACe_YmzRA78a4GQX2IL9jqa40LZyLUjoRSx1nylGkl1Q Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:10:20.716475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd591617d7554c23b925b2372ead2475", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd591617d7554c23b925b2372ead2475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 69f6e7250ac24151ada8cd4bdde3e070 Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Volume 2e724bfb-50bf-4846-b19f-33de2d5ba762 could not be found. Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '2e724bfb-50bf-4846-b19f-33de2d5ba762'} Aug 06 22:10:20.717705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e724bfb-50bf-4846-b19f-33de2d5ba762 could not be found. (HTTP 404) (Request-ID: req-9fe7c6f0-af62-4f16-9b44-4cbe44e4a4ff) Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.718677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 22:10:20.719878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e724bfb-50bf-4846-b19f-33de2d5ba762 could not be found. Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 22:10:20.720700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e724bfb-50bf-4846-b19f-33de2d5ba762 could not be found. Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e724bfb-50bf-4846-b19f-33de2d5ba762 could not be found. Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1db9dbcb-36ac-468f-9d62-fc7d02afb57f tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Returning 404 to user: Volume 2e724bfb-50bf-4846-b19f-33de2d5ba762 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1db9dbcb-36ac-468f-9d62-fc7d02afb57f tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/2e724bfb-50bf-4846-b19f-33de2d5ba762" status: 404 len: 109 microversion: 2.1 time: 0.292252 Aug 06 22:10:20.721864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 7/8] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:10:20 2022] DELETE /compute/v2.1/os-volumes/2e724bfb-50bf-4846-b19f-33de2d5ba762 => generated 109 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:10:20.729930 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f70381e6-9917-4a96-85a3-648c3b7c05e6 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Calling method '.version_select at 0x7f30c8795d30>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:20.781665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c5566865-0ca7-4f6c-b753-d6b62cb097b9 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b" status: 200 len: 352 microversion: 2.1 time: 0.073753 Aug 06 22:10:20.781665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 2/9] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:20 2022] GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:10:20.832372 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-f70381e6-9917-4a96-85a3-648c3b7c05e6 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] HTTP exception thrown: Volume 6a711d62-06b2-4653-8b02-fb7f7c84f20d could not be found. Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f70381e6-9917-4a96-85a3-648c3b7c05e6 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Request method failure captured: Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/os-volumes/6a711d62-06b2-4653-8b02-fb7f7c84f20d HTTP/1.1 Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubJddWP6uJBh0JVtQdekIkCQAWGNhoFqmUqZ6E5bsOeD-edFpGOe2Xfx9RPaOOTp8mEWTd5DhkjcVOFeDOEgKzqmwxVTjSE4n2mw1Yuv8xSirArx7276lIEy_EwEasePCZACe_YmzRA78a4GQX2IL9jqa40LZyLUjoRSx1nylGkl1Q Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:10:20.834987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd591617d7554c23b925b2372ead2475", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd591617d7554c23b925b2372ead2475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd591617d7554c23b925b2372ead2475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: dd591617d7554c23b925b2372ead2475 Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesNegativeTest-913933531 Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 69f6e7250ac24151ada8cd4bdde3e070 Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesNegativeTest-913933531-project Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Volume 6a711d62-06b2-4653-8b02-fb7f7c84f20d could not be found. Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '6a711d62-06b2-4653-8b02-fb7f7c84f20d'} Aug 06 22:10:20.836253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a711d62-06b2-4653-8b02-fb7f7c84f20d could not be found. (HTTP 404) (Request-ID: req-01cc1876-4e5d-49c0-903e-af28f76552fa) Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.837050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:10:20.838265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a711d62-06b2-4653-8b02-fb7f7c84f20d could not be found. Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 22:10:20.839400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a711d62-06b2-4653-8b02-fb7f7c84f20d could not be found. Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a711d62-06b2-4653-8b02-fb7f7c84f20d could not be found. Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f70381e6-9917-4a96-85a3-648c3b7c05e6 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] Returning 404 to user: Volume 6a711d62-06b2-4653-8b02-fb7f7c84f20d could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f70381e6-9917-4a96-85a3-648c3b7c05e6 tempest-VolumesNegativeTest-913933531 tempest-VolumesNegativeTest-913933531-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6a711d62-06b2-4653-8b02-fb7f7c84f20d" status: 404 len: 109 microversion: 2.1 time: 0.113198 Aug 06 22:10:20.844757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 8/10] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:20 2022] GET /compute/v2.1/os-volumes/6a711d62-06b2-4653-8b02-fb7f7c84f20d => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:10:21.686036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b608a46d-0edd-4e9d-8f08-db9241c53b89 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c8818310>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:21.795022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-db441707-ac15-4daf-adf6-e2c222238339 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Calling method '.version_select at 0x7f30c8845280>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:21.871909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b608a46d-0edd-4e9d-8f08-db9241c53b89 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/535fe96c-7143-47c1-a865-72980719b418" status: 200 len: 350 microversion: 2.1 time: 0.189848 Aug 06 22:10:21.880804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 3/11] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:21 2022] GET /compute/v2.1/os-volumes/535fe96c-7143-47c1-a865-72980719b418 => generated 350 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:21.969548 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-db441707-ac15-4daf-adf6-e2c222238339 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b" status: 200 len: 353 microversion: 2.1 time: 0.170943 Aug 06 22:10:21.969548 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 9/12] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:21 2022] GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:10:21.977598 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f977841c-3566-4294-9efe-5bc3bd49214a tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Calling method '.version_select at 0x7f30c8818af0>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:22.389427 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f977841c-3566-4294-9efe-5bc3bd49214a tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b" status: 200 len: 353 microversion: 2.1 time: 0.418747 Aug 06 22:10:22.389984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 4/13] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:21 2022] GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b => generated 353 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:22.412865 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-39515414-e01d-49d6-83c1-a9753be3401f tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Calling method '.version_select at 0x7f30c8795160>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:22.914422 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-39515414-e01d-49d6-83c1-a9753be3401f tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b" status: 202 len: 0 microversion: 2.1 time: 0.508956 Aug 06 22:10:22.918103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 10/14] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:10:22 2022] DELETE /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:10:22.935980 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2c7c5390-d122-4135-81bd-f00214b5f1c8 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Calling method '.version_select at 0x7f30c887bdc0>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:23.252590 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2c7c5390-d122-4135-81bd-f00214b5f1c8 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b" status: 200 len: 352 microversion: 2.1 time: 0.333098 Aug 06 22:10:23.259227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 5/15] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:22 2022] GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b => generated 352 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:24.266849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e18d0e07-122c-4533-9e2b-84c0189191d1 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Calling method '.version_select at 0x7f30c87a5280>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:24.319122 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-e18d0e07-122c-4533-9e2b-84c0189191d1 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] HTTP exception thrown: Volume 121d2eb3-902e-4d60-883a-611b4067748b could not be found. Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e18d0e07-122c-4533-9e2b-84c0189191d1 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Request method failure captured: Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b HTTP/1.1 Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubJ6f6Q7sjfeiEKr4ljahq1CEBjYjEggN_SqXat7ckImUwAXYbz9n6vh2-g-z2SRwYjOSWZhSDCxXHrNiW1puKiAF-Hdno-xY2S1G-xNQTTa9r6g29T5EAD5PIYYnNeJt5I6RygbHeCDW9ROJfOLhSW1uakwu-uxKUEoTJ_KCJODZg Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 2d9aaf79afbe4f87a96eae7bb7d6b8e3 Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesGetTestJSON-1528576295 Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:10:24.322815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2d9aaf79afbe4f87a96eae7bb7d6b8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2d9aaf79afbe4f87a96eae7bb7d6b8e3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2d9aaf79afbe4f87a96eae7bb7d6b8e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2d9aaf79afbe4f87a96eae7bb7d6b8e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesGetTestJSON-1528576295 Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 2d9aaf79afbe4f87a96eae7bb7d6b8e3 Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesGetTestJSON-1528576295 Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesGetTestJSON-1528576295-project Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 2625522503744c9993b08b326a6c5e7f Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesGetTestJSON-1528576295-project Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Volume 121d2eb3-902e-4d60-883a-611b4067748b could not be found. Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '121d2eb3-902e-4d60-883a-611b4067748b'} Aug 06 22:10:24.323846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 121d2eb3-902e-4d60-883a-611b4067748b could not be found. (HTTP 404) (Request-ID: req-40925a81-3005-4e1e-a580-6d55c709de5f) Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:24.324629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:10:24.325484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 121d2eb3-902e-4d60-883a-611b4067748b could not be found. Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 22:10:24.326374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 121d2eb3-902e-4d60-883a-611b4067748b could not be found. Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 121d2eb3-902e-4d60-883a-611b4067748b could not be found. Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e18d0e07-122c-4533-9e2b-84c0189191d1 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] Returning 404 to user: Volume 121d2eb3-902e-4d60-883a-611b4067748b could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:10:24.327226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e18d0e07-122c-4533-9e2b-84c0189191d1 tempest-VolumesGetTestJSON-1528576295 tempest-VolumesGetTestJSON-1528576295-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b" status: 404 len: 109 microversion: 2.1 time: 0.061424 Aug 06 22:10:24.330349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 11/16] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:24 2022] GET /compute/v2.1/os-volumes/121d2eb3-902e-4d60-883a-611b4067748b => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:10:24.389774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-89211b6e-6102-423e-841d-84b4fe7f5fa6 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c8818ca0>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:24.504549 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-89211b6e-6102-423e-841d-84b4fe7f5fa6 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/3631103f-cc31-462f-9a86-18bf32666633" status: 200 len: 350 microversion: 2.1 time: 0.119188 Aug 06 22:10:24.505112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 6/17] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:24 2022] GET /compute/v2.1/os-volumes/3631103f-cc31-462f-9a86-18bf32666633 => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:26.696366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-943ce61a-21e8-4347-bcf7-5783e69caf92 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c8795b80>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:26.837619 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-943ce61a-21e8-4347-bcf7-5783e69caf92 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f31b57cd-ef32-4a87-9a7a-358a182097fc" status: 200 len: 351 microversion: 2.1 time: 0.146360 Aug 06 22:10:26.838559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 12/18] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:10:26 2022] GET /compute/v2.1/os-volumes/f31b57cd-ef32-4a87-9a7a-358a182097fc => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:26.852515 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-afd20d79-fa65-4ad7-8e91-e1b85edf1acc tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c88183a0>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:27.001667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-afd20d79-fa65-4ad7-8e91-e1b85edf1acc tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.153191 Aug 06 22:10:27.002228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 7/19] 10.222.0.18 () {58 vars in 1134 bytes} [Sat Aug 6 22:10:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:27.017594 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-eab6d8a7-7692-470f-bd02-b66821fe97e3 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c8795a60>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:27.117078 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-eab6d8a7-7692-470f-bd02-b66821fe97e3 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104197 Aug 06 22:10:27.118273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 13/20] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Aug 6 22:10:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:27.131693 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-009f23fc-6c1a-41c2-abf2-460bb094f5a7 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c8818040>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:27.305433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-009f23fc-6c1a-41c2-abf2-460bb094f5a7 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.177394 Aug 06 22:10:27.306210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 8/21] 10.222.0.18 () {58 vars in 1134 bytes} [Sat Aug 6 22:10:27 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:27.322165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c411ccfb-d260-425c-9aa1-c0fb42a0d50f tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c87a29d0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:27.610108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c411ccfb-d260-425c-9aa1-c0fb42a0d50f tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.292248 Aug 06 22:10:27.612717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 14/22] 10.222.0.18 () {58 vars in 1167 bytes} [Sat Aug 6 22:10:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:27.627735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-12477e7c-b827-42bc-a6dc-d90e3406b302 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c887be50>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:27.872802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-12477e7c-b827-42bc-a6dc-d90e3406b302 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.250038 Aug 06 22:10:27.875235 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 9/23] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Aug 6 22:10:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:27.889674 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a6bba69d-5467-4575-88f3-6f6747531277 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c87a7c10>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:28.133789 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a6bba69d-5467-4575-88f3-6f6747531277 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.249262 Aug 06 22:10:28.135689 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 15/24] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Aug 6 22:10:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:28.150179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d05e14fe-8253-4aee-af40-167598a0f575 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c88280d0>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:28.357422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d05e14fe-8253-4aee-af40-167598a0f575 tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.212815 Aug 06 22:10:28.366626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 10/25] 10.222.0.18 () {58 vars in 1188 bytes} [Sat Aug 6 22:10:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:28.381652 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-dd85dc6a-1ed2-4779-9cd1-3f947f6886cd tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] Calling method '.version_select at 0x7f30c8845430>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:28.547645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-dd85dc6a-1ed2-4779-9cd1-3f947f6886cd tempest-VolumesTestJSON-1488494220 tempest-VolumesTestJSON-1488494220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.178951 Aug 06 22:10:28.549396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 16/26] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Aug 6 22:10:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:29.939860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0bd21f52-d566-4c76-90eb-2e8c8d8ef7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: .version_select at 0x7f30c8821700>, body: {"keypair": {"name": "tempest-keypair-596356286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/4ycnpWf45vmjH75aiWoXDlEU1gCJxKm90lPwOVqztI/spROW5N0SX2Pgoi9FJPAD3PfG8b3gqp99sQVMTSfmpXMEPANOTc1jV3QIsNSkUqwwphPaI9Dva+ZQqymHyeg=="}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:30.123538 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-0bd21f52-d566-4c76-90eb-2e8c8d8ef7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for project f4867885fc0d4ca29d2d674465398466. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:10:30.160684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-0bd21f52-d566-4c76-90eb-2e8c8d8ef7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for user 0d6e35038fed4b44b986902a5ef55ce8 and project f4867885fc0d4ca29d2d674465398466. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:10:30.390239 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0bd21f52-d566-4c76-90eb-2e8c8d8ef7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.181665 Aug 06 22:10:30.391239 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 11/27] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:10:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:32.586526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cb59f1ee-9b63-4fa3-bc8b-8660d8fab506 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'create', calling method: .version_select at 0x7f30c88738b0>, body: {"keypair": {"name": "tempest-keypair-834640752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5pKadnBnmjfPAeaBSKZDo4+wxYqSLiwI2Rh58IVh1QJ0PYhJDY0umtQycQMgyhoYprs7mHsC2vMT/jiraiDACbm9WZBw4TjNmFmfpu3cpNTYpeVf2FP2Keo12lPX4YXA=="}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:32.809175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-cb59f1ee-9b63-4fa3-bc8b-8660d8fab506 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Getting quotas for project 8e000f22d8284f6ea2178aa17dc70151. Resources: {'key_pairs'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:10:32.851844 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-cb59f1ee-9b63-4fa3-bc8b-8660d8fab506 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Getting quotas for user dfc4de8c76d0470a892dc8bad4d29441 and project 8e000f22d8284f6ea2178aa17dc70151. Resources: {'key_pairs'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:10:33.084883 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cb59f1ee-9b63-4fa3-bc8b-8660d8fab506 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.828106 Aug 06 22:10:33.086166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 17/28] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Aug 6 22:10:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 830 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 22:10:34.412047 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-20551133", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "networks": [{"uuid": "332085be-3897-4580-b6ed-13a02fce4721"}]}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:34.660513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] validate_networks() for [('332085be-3897-4580-b6ed-13a02fce4721', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:10:36.254314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:10:36.254935 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:10:36.255398 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:10:36.256034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:10:36.256801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:10:36.278905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:36.279756 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:36.280592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:36.297914 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:36.298403 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:36.303103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:36.320382 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-753335696", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15a3ad5d-cae3-43a4-b19f-06f85bc9b5e1"}], "security_groups": [{"name": "tempest-securitygroup--1621293422"}], "key_name": "tempest-keypair-596356286", "user_data": "}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:36.347439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Getting quotas for project b1386a21549b4faf87836a9be75c670c. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:10:36.366032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Getting quotas for user 13f161eb377e4f809b2232c1047c0bb5 and project b1386a21549b4faf87836a9be75c670c. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:10:36.410814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:10:36.432367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:10:36.640748 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-45e90d05-fbb0-4bbc-b1aa-a0fca177f9e9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.489820 Aug 06 22:10:36.643166 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 12/29] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:10:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:10:36.665630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e1f96970-449f-4ad4-bd55-6a0589fb13d4 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:36.666498 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e1f96970-449f-4ad4-bd55-6a0589fb13d4 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:36.794434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] validate_networks() for [('15a3ad5d-cae3-43a4-b19f-06f85bc9b5e1', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:10:36.902636 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e1f96970-449f-4ad4-bd55-6a0589fb13d4 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:36.931737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e1f96970-449f-4ad4-bd55-6a0589fb13d4 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1213 microversion: 2.1 time: 0.279277 Aug 06 22:10:36.936298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 13/30] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:36 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1213 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:37.970523 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2c20b030-2a5f-4342-9e03-44f99d432beb tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:37.973504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2c20b030-2a5f-4342-9e03-44f99d432beb tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:38.082480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2c20b030-2a5f-4342-9e03-44f99d432beb tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:38.100935 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2c20b030-2a5f-4342-9e03-44f99d432beb tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1213 microversion: 2.1 time: 0.149203 Aug 06 22:10:38.108841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 14/31] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:37 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:38.140493 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:10:38.141471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:10:38.142204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:10:38.143468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:10:38.143990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:10:38.156792 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:38.157360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:38.157868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:38.158817 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:38.159348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:38.160616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:38.192898 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for project f4867885fc0d4ca29d2d674465398466. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:10:38.203815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for user 0d6e35038fed4b44b986902a5ef55ce8 and project f4867885fc0d4ca29d2d674465398466. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:10:38.224262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:10:38.227310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:10:38.468121 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3128a707-373b-49ed-998e-55c931355180 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.153182 Aug 06 22:10:38.473696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 18/32] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:10:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 22:10:38.481835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ab88ecaf-64bf-4f39-8fa7-70dbbf63d0a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:38.482537 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ab88ecaf-64bf-4f39-8fa7-70dbbf63d0a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:38.583604 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab88ecaf-64bf-4f39-8fa7-70dbbf63d0a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:38.592046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ab88ecaf-64bf-4f39-8fa7-70dbbf63d0a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1240 microversion: 2.1 time: 0.114586 Aug 06 22:10:38.593421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 15/33] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:38 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1240 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:38.711759 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-643646302", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e88b6eb-9927-4041-97fb-cf4152442c9e"}], "security_groups": [{"name": "tempest-securitygroup--682098048"}], "key_name": "tempest-keypair-834640752", "user_data": "}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:38.864874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] validate_networks() for [('8e88b6eb-9927-4041-97fb-cf4152442c9e', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:10:39.129997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-393e457f-5edd-4190-825b-2aff8ca867ce tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:39.130605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-393e457f-5edd-4190-825b-2aff8ca867ce tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:39.276041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-393e457f-5edd-4190-825b-2aff8ca867ce tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:39.298194 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-393e457f-5edd-4190-825b-2aff8ca867ce tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1213 microversion: 2.1 time: 0.172212 Aug 06 22:10:39.300724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 16/34] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:39 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:39.488266 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:10:39.490794 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:10:39.491324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:10:39.492453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:10:39.495417 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:10:39.508630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:39.513456 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:39.514042 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:39.515448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:39.515909 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:39.518979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:39.552650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Getting quotas for project 8e000f22d8284f6ea2178aa17dc70151. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:10:39.567157 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Getting quotas for user dfc4de8c76d0470a892dc8bad4d29441 and project 8e000f22d8284f6ea2178aa17dc70151. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:10:39.591373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:10:39.596147 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:10:39.615248 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-595ed8e5-6d25-418e-a3ac-787b35700c47 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:39.615916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-595ed8e5-6d25-418e-a3ac-787b35700c47 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:39.707692 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-595ed8e5-6d25-418e-a3ac-787b35700c47 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:39.716778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-595ed8e5-6d25-418e-a3ac-787b35700c47 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1240 microversion: 2.1 time: 0.105993 Aug 06 22:10:39.717799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 17/35] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:39 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:39.786533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f7912340-92f0-474b-a89b-5a92952c634e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.082067 Aug 06 22:10:39.787933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 19/36] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Aug 6 22:10:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 22:10:39.798707 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a870f24c-0ebe-4b68-938a-d00e77daea5e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:39.799330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a870f24c-0ebe-4b68-938a-d00e77daea5e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:39.896453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a870f24c-0ebe-4b68-938a-d00e77daea5e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:39.907885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a870f24c-0ebe-4b68-938a-d00e77daea5e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:39.915611 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a870f24c-0ebe-4b68-938a-d00e77daea5e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:39.918936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a870f24c-0ebe-4b68-938a-d00e77daea5e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1280 microversion: 2.20 time: 0.124804 Aug 06 22:10:39.920143 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:39 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:10:40.319632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:40.320610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:40.362218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:40.363047 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:40.363662 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:40.364751 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:40.365354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:40.365930 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:40.583126 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:40.599049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-811737a1-d3ff-4459-a162-aad3a643e3c2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1217 microversion: 2.1 time: 0.283410 Aug 06 22:10:40.599760 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 20/38] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:40 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1217 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:40.744499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:40.745220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:40.752334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:40.753034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:40.753463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:40.754152 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:40.754745 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:40.755318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:40.943326 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2c121747-8341-4269-9752-4489fe822db0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:40.943937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2c121747-8341-4269-9752-4489fe822db0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:41.024702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:41.038203 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6858f177-e412-4d1f-a5fe-ad7bea52c586 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1244 microversion: 2.1 time: 0.297717 Aug 06 22:10:41.038872 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 19/39] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:40 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1244 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:41.058150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c121747-8341-4269-9752-4489fe822db0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:41.075274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c121747-8341-4269-9752-4489fe822db0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:41.077170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c121747-8341-4269-9752-4489fe822db0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:41.078406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2c121747-8341-4269-9752-4489fe822db0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1280 microversion: 2.20 time: 0.139069 Aug 06 22:10:41.079180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:40 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1280 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:41.620384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:41.621019 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:41.627529 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:41.628009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:41.628520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:41.629259 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:41.629711 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:41.630136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:41.693348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:41.700846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-816c7079-3234-43ae-9df6-f3b53147c28a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1217 microversion: 2.1 time: 0.084337 Aug 06 22:10:41.701415 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:41 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:42.058402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:42.058946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:42.066275 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:42.066846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:42.067279 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:42.068035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:42.068519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:42.068948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:42.105078 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:42.105743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:42.112596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:42.113115 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:42.113558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:42.114259 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:42.114719 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:42.115148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:42.130377 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:42.138567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-80f3880a-3e31-4365-bf18-2c0293dffe00 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1244 microversion: 2.1 time: 0.084124 Aug 06 22:10:42.139178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:42 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:42.179803 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:42.189787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:42.190718 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:42.191945 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6f75efbf-79ef-4d08-9597-4193ed0feb29 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1284 microversion: 2.20 time: 0.091130 Aug 06 22:10:42.192517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 21/43] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:42 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:42.723024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:42.723632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:42.730040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:42.730583 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:42.731016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:42.732596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:42.733094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:42.733519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:42.795191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:42.803054 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1bf69f5e-3e0d-4f99-9187-4d30962100b2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1217 microversion: 2.1 time: 0.083990 Aug 06 22:10:42.803599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 23/44] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:42 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:43.159127 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:43.159748 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:43.166089 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:43.166714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:43.167244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:43.167940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:43.168388 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:43.168833 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:43.214669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:43.215424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:43.221768 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:43.222659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:43.223259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:43.225361 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:43.225987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:43.226822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:43.232049 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:43.244869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ba564d18-1514-4829-b26b-9f0e4c9721e4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1244 microversion: 2.1 time: 0.089399 Aug 06 22:10:43.246149 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 22/45] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:43 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:43.294544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:43.303030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:43.304572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:43.305675 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-dbc0f116-9b7e-4763-b157-cb628a36ac34 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1284 microversion: 2.20 time: 0.095001 Aug 06 22:10:43.306237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:43 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:43.823094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:43.823661 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:43.835302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:43.835787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:43.836224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:43.837407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:43.840765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:43.840765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:43.907512 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:43.917915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b4bdf315-6887-46ba-91e2-7d275be65069 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1217 microversion: 2.1 time: 0.098231 Aug 06 22:10:43.919096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 23/47] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:43 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:44.266918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:44.267556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:44.273612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:44.274035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:44.274464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:44.275141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:44.275584 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:44.276001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:44.328665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:44.329856 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:44.338178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:44.338673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:44.340215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:44.341130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:44.341587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:44.342580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:44.360920 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:44.369266 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6ac1d384-44dc-4c2c-9e6a-b308043f481f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1244 microversion: 2.1 time: 0.106194 Aug 06 22:10:44.370203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:44 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1244 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:44.440507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:44.453753 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:44.456132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:44.457983 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-64d25b57-4e4f-40f2-b85b-6367545958c0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1276 microversion: 2.20 time: 0.133187 Aug 06 22:10:44.464456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:44 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:10:44.943057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:44.946024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:44.953758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:44.954802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:44.955387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:44.956463 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:44.957183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:44.957753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:45.051708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:45.059958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-970a79c7-0139-4d20-89d9-bd64e413d62d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1265 microversion: 2.1 time: 0.124704 Aug 06 22:10:45.061695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 26/50] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:44 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:45.391378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:45.392148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:45.399271 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:45.399652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:45.400233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:45.405142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:45.405142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:45.405142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:45.481428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:45.483860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:45.485248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:45.493464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-69bece35-baee-4539-b19f-fe3e8d852d4c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1292 microversion: 2.1 time: 0.106157 Aug 06 22:10:45.494098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:45.494227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 25/51] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:45 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1292 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:45.494878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:45.495467 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:45.496171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:45.496641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:45.497274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:45.573708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:45.582937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:45.584433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:45.585838 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-70cbbf36-7c48-4553-8449-d069f96a38d6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1332 microversion: 2.20 time: 0.106584 Aug 06 22:10:45.587233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:45 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:10:46.084117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:46.085137 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:46.093097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:46.094048 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:46.094722 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:46.095799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:46.096500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:46.097131 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:46.227271 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:46.240444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2dd93984-93e2-4ed4-97e8-60c34964a2b7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1283 microversion: 2.1 time: 0.160796 Aug 06 22:10:46.250843 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 26/53] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:46 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:46.518599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:46.519979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:46.526868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:46.527360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:46.528022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:46.528829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:46.529319 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:46.529900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:46.611481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:46.612105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:46.614359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:46.625360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:46.633280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:46.634015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:46.635864 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:46.640673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:46.641786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:46.643522 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:46.646881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bdd01cb5-0fb7-4881-b694-3dde83ca58d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1310 microversion: 2.1 time: 0.132818 Aug 06 22:10:46.650095 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 28/54] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:46 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1310 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:46.730790 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:46.753189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:46.755464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:46.756829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6cc6fd27-cd39-49bc-a1d4-81358ced2518 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1338 microversion: 2.20 time: 0.150200 Aug 06 22:10:46.757606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 27/55] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:46 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1338 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:47.265208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:47.266003 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:47.276733 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:47.277547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:47.277985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:47.278679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:47.279131 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:47.279686 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:47.668775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:47.669397 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:47.686952 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:47.697671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:47.697671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:47.697671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:47.697671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:47.698622 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:47.735221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:47.745681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-74c3a03d-0ed0-499a-a86b-5789bf7d1f6d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.486761 Aug 06 22:10:47.746795 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 29/56] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:47 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:47.782012 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:47.783849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:47.794296 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:47.794890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:47.797450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:47.800080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:47.801156 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:47.801156 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:47.864136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:47.872317 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-965d0a7f-6056-4d05-ba0e-cc4d704dff38 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1298 microversion: 2.1 time: 0.207880 Aug 06 22:10:47.880036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 28/57] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:47 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1298 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:48.057111 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:48.067193 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:48.070947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:48.078506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ca6e8861-a60b-4118-a452-28059a5a5028 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.300363 Aug 06 22:10:48.080288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 30/58] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:47 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:48.927318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:48.927318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:48.927318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:48.927318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:48.929791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:48.929791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:48.929791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:48.929791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:48.930405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:48.930405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:48.930405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:48.930405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:48.930942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:48.930942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:48.930942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:48.930942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:48.947446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:48.975395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-42113045-747a-4f7f-b12e-1c5ee9dac4e3 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.192003 Aug 06 22:10:48.975395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:48 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:49.103524 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:49.104127 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:49.111029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:49.111516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:49.112025 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:49.112651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:49.113105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:49.113524 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:49.118849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:49.127100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-140fe520-024e-4d0d-9813-9a09a4505e99 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.226544 Aug 06 22:10:49.140431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 31/60] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:48 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:49.250048 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:49.262509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:49.264810 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:49.266058 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-366ddf09-2843-43f1-bc6a-81fb8204e4df tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.166836 Aug 06 22:10:49.266616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:49 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:50.003030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:50.003603 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:50.005505 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=4 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:50.010316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:50.010797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:50.011227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:50.011956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:50.012423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:50.012847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:50.143737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:50.150262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:50.150951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:50.151256 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f9002eab-690d-42e7-8df1-2c9da13d3d8f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.152235 Aug 06 22:10:50.151825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 32/62] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:49 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:50.153820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=22 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:50.157978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:50.158445 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:50.158873 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:50.159550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:50.159997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:50.161508 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:50.290629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:50.291531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:50.301345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:50.304481 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:50.305041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:50.306473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:50.308438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:50.310211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:50.327484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:50.337990 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-008733fc-1291-45f4-bb08-d0a757e1cf44 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.191606 Aug 06 22:10:50.339410 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 31/63] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:50 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:50.472278 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:50.480633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:50.482139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:50.484553 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-abeeaa95-b0fb-43dd-b2a8-b14061a3c6c5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.198723 Aug 06 22:10:50.493309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:50 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:51.175306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:51.176989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:51.184093 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:51.185471 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:51.186809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:51.187732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:51.188714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:51.195211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:51.365822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:51.367484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:51.369843 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=18 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:51.385023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:51.385878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:51.391706 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:51.392744 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:51.393424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:51.394905 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:51.450853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:51.461450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-22a2751b-42fb-45a8-805d-e94e64af9370 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.291654 Aug 06 22:10:51.462690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 32/65] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:51 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:51.521446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:51.522477 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:51.529029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:51.530752 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:51.531401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:51.532372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:51.532979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:51.533639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:51.650553 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:51.658412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0455f1f8-14d1-490d-8b62-e523dafd4043 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.302240 Aug 06 22:10:51.659310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 34/66] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:51 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:51.702744 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:51.711802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:51.712388 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:51.713505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-758ccb36-596f-470f-9abc-d3fcdb4d0f0c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.202201 Aug 06 22:10:51.714213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:51 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:10:52.487199 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:52.488309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:52.498576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:52.499705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:52.500424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:52.501910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:52.502556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:52.503388 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:52.666509 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:52.674673 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-45cf8615-d3c4-4a29-867c-2d4ee3d43d65 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.194917 Aug 06 22:10:52.675557 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 35/68] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:52 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:52.694051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:52.695498 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:52.710859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:52.711345 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:52.711778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:52.712708 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:52.713297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:52.713857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:52.736973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:52.737743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:52.746247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:52.747271 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:52.747999 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:52.749530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:52.753176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:52.754070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:53.019107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:53.026794 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:53.037325 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:53.039861 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:53.041674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:53.041827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1dac0e7f-1091-4ca8-9996-d9a5e434ce76 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.310324 Aug 06 22:10:53.042579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 36/69] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:52 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:53.052230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-77b97b2b-2165-4ed6-8a26-3437231b94bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.375201 Aug 06 22:10:53.056559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 34/70] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:52 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:53.696765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:53.697373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:53.704806 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:53.705851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:53.706745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:53.707756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:53.708635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:53.721293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:53.952961 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:53.966232 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-503f23f9-026c-4340-84bd-9426afa1221d tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.273291 Aug 06 22:10:53.981827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 37/71] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:53 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:54.080382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:54.081452 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:54.082523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:54.082986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:54.094990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:54.095839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:54.096670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:54.097873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:54.098075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:54.098584 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:54.099015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:54.099448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:54.099724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:54.100176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:54.100526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:54.100625 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:54.116186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:54.407294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:54.419270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:54.422035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:54.423544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-02b70e5e-fd04-4ea5-bacf-ab204f8accd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.346284 Aug 06 22:10:54.424649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 38/72] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:54 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:10:54.472442 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:54.484095 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f76a519d-78c8-4554-9248-994e4c28563a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.409497 Aug 06 22:10:54.484742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 35/73] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:54 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:54.990209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:54.991387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:55.015068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:55.015887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:55.019137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:55.022279 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:55.024368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:55.026533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:55.448770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:55.450316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:55.468180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:55.471645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:55.472608 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:55.474066 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:55.474798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:55.476703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:55.512289 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:55.528309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-58ae6898-ab7a-44b8-9cdd-8e654fd7d8c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.542428 Aug 06 22:10:55.543780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 39/74] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:54 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:55.571087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:55.572232 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:55.583661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:55.587936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:55.587936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:55.587936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:55.587936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:55.588243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:56.043620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:56.059153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:56.065590 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:56.072534 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a5407f8c-46f1-4c0e-813d-b06b67b251dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.628957 Aug 06 22:10:56.094408 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 36/75] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:55 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:10:56.260853 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:56.265345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-47ab1106-d02b-4e2d-ba60-97db9ba562ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.713831 Aug 06 22:10:56.265938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 40/76] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:55 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:56.554194 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:56.554194 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:56.578757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:56.582787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:56.582787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:56.582787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:56.582787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:56.583204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:56.777769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-00fc09d5-bdab-4e68-8ecc-b7aa6321ed37 req-cef7f8cb-d64b-454f-a1ab-754ac3b9f9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7471b413-f47d-4f7a-a2f8-1e4131d39531", "tag": "04fbb9fe-cdaf-4773-ae55-3a9eb80e33a0"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:56.788673 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-00fc09d5-bdab-4e68-8ecc-b7aa6321ed37 req-cef7f8cb-d64b-454f-a1ab-754ac3b9f9c2 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:56.789231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-00fc09d5-bdab-4e68-8ecc-b7aa6321ed37 req-cef7f8cb-d64b-454f-a1ab-754ac3b9f9c2 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:56.789661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-00fc09d5-bdab-4e68-8ecc-b7aa6321ed37 req-cef7f8cb-d64b-454f-a1ab-754ac3b9f9c2 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:56.855090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-00fc09d5-bdab-4e68-8ecc-b7aa6321ed37 req-cef7f8cb-d64b-454f-a1ab-754ac3b9f9c2 service nova] Creating event network-changed:04fbb9fe-cdaf-4773-ae55-3a9eb80e33a0 for instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 on hv-cinder-84984 Aug 06 22:10:56.859204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-00fc09d5-bdab-4e68-8ecc-b7aa6321ed37 req-cef7f8cb-d64b-454f-a1ab-754ac3b9f9c2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 22:10:56.860222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-00fc09d5-bdab-4e68-8ecc-b7aa6321ed37 req-cef7f8cb-d64b-454f-a1ab-754ac3b9f9c2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 22:10:56.870525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:56.871050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:56.872013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:56.875623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:56.876775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:56.880578 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:56.901323 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.compute.rpcapi [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 22:10:56.902106 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] Releasing lock "compute-rpcapi-router" {{(pid=118457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 22:10:56.937467 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-de8dc21b-9fc4-4e60-b616-e9dc41eaf202 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265187 Aug 06 22:10:56.938152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 41/77] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:57.009348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:57.031859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4656510a-36ce-4ec1-b148-6f7fe0d6e903 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.477852 Aug 06 22:10:57.032691 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 37/78] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:56 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:57.049220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-b3f31c43-508c-4113-abd5-7fe02619ac3c req-ada70f31-cf2d-4367-bfc0-6770c2af1380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209d7c8e-59b6-4313-a518-a2c8c7eeb290", "tag": "608fc1c7-cd79-4b52-883b-01561aed2ea4"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:57.065145 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b3f31c43-508c-4113-abd5-7fe02619ac3c req-ada70f31-cf2d-4367-bfc0-6770c2af1380 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:57.065773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b3f31c43-508c-4113-abd5-7fe02619ac3c req-ada70f31-cf2d-4367-bfc0-6770c2af1380 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:57.066216 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b3f31c43-508c-4113-abd5-7fe02619ac3c req-ada70f31-cf2d-4367-bfc0-6770c2af1380 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:57.110214 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-b3f31c43-508c-4113-abd5-7fe02619ac3c req-ada70f31-cf2d-4367-bfc0-6770c2af1380 service nova] Creating event network-changed:608fc1c7-cd79-4b52-883b-01561aed2ea4 for instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 on hv-cinder-84984 Aug 06 22:10:57.113477 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:57.114204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:57.126249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:57.128159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-b3f31c43-508c-4113-abd5-7fe02619ac3c req-ada70f31-cf2d-4367-bfc0-6770c2af1380 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170183 Aug 06 22:10:57.129960 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:57.130598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 42/79] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:57.130777 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:57.132373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:57.137759 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:57.137759 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:57.293972 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:57.296335 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:57.308975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:57.309911 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:57.310975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:57.317931 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:57.320249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:57.322293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:57.341045 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:57.350703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:57.352889 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:57.360569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9ea32245-6b7c-475b-b396-1103b96cf890 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.247285 Aug 06 22:10:57.360569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 38/80] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:57 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:10:57.458827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:57.466145 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ce53ccc9-52aa-4f87-8dee-c1784aa79f36 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.178461 Aug 06 22:10:57.467413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 43/81] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:57 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:58.054809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:58.055464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:58.058356 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:58.065785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:58.066268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:58.073968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:58.073968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:58.073968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:58.073968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:58.213921 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:58.229540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4437a91f-7d60-48ea-bf60-2ed71d5943f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.173282 Aug 06 22:10:58.229540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 39/82] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:58 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:10:58.378418 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:58.379021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:58.383511 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:58.399720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:58.400276 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:58.407358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:58.407358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:58.407358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:58.407358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:58.487198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:58.488219 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:58.494937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:58.495548 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:58.495991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:58.496719 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:58.497172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:58.499784 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:58.578465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:58.602390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:58.602390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:58.614520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c4df3def-46fd-43d0-9169-45c46ca24f98 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.227309 Aug 06 22:10:58.633902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 44/83] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:58 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:10:58.683470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:58.691148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1b3ce697-8670-49f1-a866-4e3f5f91154c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.207837 Aug 06 22:10:58.692318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 40/84] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:58 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:58.956953 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-0a3c677d-749f-4821-8a8b-cff7d7a64adf req-329b040f-cb2c-478c-ba2c-bfd5c72c5a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56213f38-4e86-47ad-b1df-7734464598ed", "tag": "bac5d3c4-a8bf-4af4-a8c0-f09c5503cf0f"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:10:58.965977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-0a3c677d-749f-4821-8a8b-cff7d7a64adf req-329b040f-cb2c-478c-ba2c-bfd5c72c5a30 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:58.966507 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-0a3c677d-749f-4821-8a8b-cff7d7a64adf req-329b040f-cb2c-478c-ba2c-bfd5c72c5a30 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:58.966928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-0a3c677d-749f-4821-8a8b-cff7d7a64adf req-329b040f-cb2c-478c-ba2c-bfd5c72c5a30 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:58.977677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-0a3c677d-749f-4821-8a8b-cff7d7a64adf req-329b040f-cb2c-478c-ba2c-bfd5c72c5a30 service nova] Creating event network-changed:bac5d3c4-a8bf-4af4-a8c0-f09c5503cf0f for instance 56213f38-4e86-47ad-b1df-7734464598ed on hv-cinder-84984 Aug 06 22:10:58.983249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-0a3c677d-749f-4821-8a8b-cff7d7a64adf req-329b040f-cb2c-478c-ba2c-bfd5c72c5a30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029936 Aug 06 22:10:58.984057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 45/85] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:10:59.247970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:59.248637 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:59.254349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:59.254826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:59.255254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:59.255933 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:59.256375 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:59.256817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:59.437321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:59.445465 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-11d83439-34c0-478c-b586-10635f669f44 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.201498 Aug 06 22:10:59.446091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:59 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:10:59.642038 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:59.643668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:59.653346 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:59.654586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:59.655341 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:59.656272 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:59.657449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:59.658189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:59.711577 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:10:59.712433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:10:59.718643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:59.719224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:59.721345 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:59.721345 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:10:59.721345 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:10:59.721345 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:10:59.886030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:59.898621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:59.898621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:59.899486 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bade09fb-6c08-42b2-aff1-bbb5850a49fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.262220 Aug 06 22:10:59.900047 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 46/87] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:10:59 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:10:59.917483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:10:59.926399 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9a211cca-ec7b-4ba5-b015-964a3c75c53d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.218612 Aug 06 22:10:59.927467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 42/88] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:10:59 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:00.466017 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:00.468116 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:00.475078 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:00.475645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:00.476502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:00.477211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:00.477815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:00.478405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:00.610253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:00.617800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-588bad3f-50ab-4238-a06b-a6aa01c9b94b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.155612 Aug 06 22:11:00.618362 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 47/89] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:00 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:00.923257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:00.924681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:00.930630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:00.931112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:00.933334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:00.933334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:00.933334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:00.933334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:00.947396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:00.948253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:00.955262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:00.955795 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:00.956265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:00.956992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:00.957448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:00.957880 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:01.338357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:01.348936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:01.357582 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-81ff531b-b707-4666-8ed6-58befba3641d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.413602 Aug 06 22:11:01.360560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 48/90] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:00 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:01.373854 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:01.375589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:01.377589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-07a3ad8a-a362-4320-9188-a88c2810b5d3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.458404 Aug 06 22:11:01.378574 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 43/91] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:00 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:01.639684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:01.640495 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:01.647124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:01.647891 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:01.648533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:01.649442 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:01.649988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:01.650914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:01.895634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:01.905932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-010b1ac5-7532-42c4-b9f4-1930cf0fdc67 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.270834 Aug 06 22:11:01.907938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 49/92] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:01 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:02.388034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:02.390101 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:02.397361 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:02.405846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:02.405846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:02.405846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:02.405846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:02.406183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:02.406778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:02.407959 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:02.414076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:02.414765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:02.415377 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:02.416223 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:02.416845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:02.417294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:02.612737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:02.622949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b0130850-69fa-4dc2-8857-abba046f840e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.240728 Aug 06 22:11:02.623526 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 44/93] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:02 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:02.669057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:02.684723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:02.687368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:02.688890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b5b81f59-2cb8-483f-b4e7-61dd57dd7882 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.287153 Aug 06 22:11:02.693856 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 50/94] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:02 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:02.930567 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:02.931217 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:02.938000 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:02.938519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:02.938956 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:02.939723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:02.940173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:02.940796 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:03.127274 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:03.135121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4a3be0ca-e0a1-4401-8661-6ee340fb99ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.208640 Aug 06 22:11:03.135697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 45/95] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:02 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:03.649041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:03.649642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:03.656825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:03.657303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:03.657760 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:03.658481 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:03.658927 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:03.659339 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:03.715400 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:03.716804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:03.723272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:03.724034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:03.724561 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:03.725320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:03.726168 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:03.726782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:03.854237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:03.870300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c9ec04f9-6418-49d3-b85b-76b62706491d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.225014 Aug 06 22:11:03.880433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 51/96] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:03 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:03.926211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:03.934570 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:03.936159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:03.937785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-cc794850-df36-4b2a-86ce-886235a8040f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.226404 Aug 06 22:11:03.938430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 46/97] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:03 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:04.158844 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:04.159719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:04.169423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:04.170514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:04.171200 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:04.172133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:04.172813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:04.173427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:04.369295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:04.380246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-dbc0a7ce-dadc-48a4-bce7-6a7c3f046a25 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.226115 Aug 06 22:11:04.395275 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 52/98] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:04 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:04.895035 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:04.896270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:04.903262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:04.904050 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:04.904679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:04.905553 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:04.906168 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:04.906782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:04.959768 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:04.960618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:04.966916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:04.967489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:04.967991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:04.968842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:04.969403 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:04.969943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:05.310902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:05.318555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2c8c5cdf-4e24-4105-a7c6-64b81ad4ae5f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.427483 Aug 06 22:11:05.319218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:04 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:05.405420 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:05.406859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:05.414215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:05.418721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:05.420200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:05.422795 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:05.423773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:05.423882 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:05.425486 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:05.426127 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:05.430035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:05.431364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4453a14b-b5a9-4de5-aac9-bf041ac0a697 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.475502 Aug 06 22:11:05.437538 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 53/100] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:04 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:05.734123 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:05.743588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c5bb39ab-f032-42e2-b577-bdd0825a79c8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.345949 Aug 06 22:11:05.756431 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 48/101] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:05 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:06.339024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:06.339626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:06.346422 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:06.349514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:06.349514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:06.349514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:06.349514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:06.349904 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:06.467464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:06.469434 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:06.478062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:06.478828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:06.479366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:06.480192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:06.481077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:06.482396 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:06.488605 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:06.496085 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a8a45b40-75f1-4977-9a5b-7dc422dbc0ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.160816 Aug 06 22:11:06.497799 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 54/102] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:06 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:06.627574 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:06.641842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:06.643380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:06.644736 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2291d766-47d4-4f29-8b02-c0c2ec4133c4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.185691 Aug 06 22:11:06.645272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 49/103] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:06 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:06.766607 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:06.767217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:06.773361 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:06.773847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:06.774282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:06.774971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:06.775425 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:06.775851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:06.780488 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:06.899310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:06.920499 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:06.927690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0eebf30d-a6ed-442f-874a-876febc55f90 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.165310 Aug 06 22:11:06.933324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 55/104] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:06 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:07.522314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:07.522314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:07.526594 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:07.527279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:07.527909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:07.529427 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:07.530641 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:07.531136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:07.670032 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:07.672101 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:07.693945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:07.693945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:07.693945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:07.693945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:07.694402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:07.694402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:07.708545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:07.720959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fec66247-235b-4893-ad42-7410d3886ec4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.206684 Aug 06 22:11:07.721985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 50/105] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:07 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:07.847962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:07.856866 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:07.858370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:07.859504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e4249561-88ad-44a5-a286-773b77a297f5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.195396 Aug 06 22:11:07.860047 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 56/106] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:07 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:07.951908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:07.952993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:07.959258 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:07.959950 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:07.960496 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:07.961556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:07.962068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:07.962684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:08.099958 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:08.103601 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:08.107907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a2f5319b-cbbc-4ed6-ad61-636c07103de9 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.163252 Aug 06 22:11:08.108514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 51/107] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:07 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:08.742552 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:08.743156 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:08.749158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:08.749641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:08.750133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:08.750850 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:08.751301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:08.751720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:08.883371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:08.884136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:08.891382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:08.891868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:08.892294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:08.893172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:08.893628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:08.894041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:08.896636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:08.904893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-81c71826-f1a7-45e4-a592-4e660eff7636 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.166070 Aug 06 22:11:08.905444 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 57/108] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:08 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:09.022410 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:09.030635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:09.032183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:09.033329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-821d78ea-bb85-4c00-a5dd-ab198591a3af tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.154087 Aug 06 22:11:09.033870 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 52/109] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:08 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:09.133690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:09.135406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:09.147696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:09.148722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:09.149515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:09.150772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:09.151518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:09.152245 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:09.652941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:09.662742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ff1d9fd5-a6f1-49e0-b14b-ab8b689172b8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.535919 Aug 06 22:11:09.664574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 58/110] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:09 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:09.925651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:09.926903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:09.932997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:09.933477 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:09.933907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:09.935128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:09.935573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:09.936010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:10.055880 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:10.056623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:10.065889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:10.066358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:10.066963 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:10.067995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:10.069408 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:10.070011 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:10.160853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:10.169726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b7d3bab9-044e-4ac9-a727-e9c499b290ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.247252 Aug 06 22:11:10.170309 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 53/111] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:09 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:10.239722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:10.249718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:10.251320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:10.252442 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ad481305-e531-42d9-aa75-9d9e60a48845 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.201257 Aug 06 22:11:10.253002 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 59/112] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:10 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:10.685406 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:10.686015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:10.692164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:10.692797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:10.696275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:10.696275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:10.696275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:10.696275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:10.836306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:10.844733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9fbe8667-5da1-4c7c-ad25-c447ff8af564 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.163031 Aug 06 22:11:10.845312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 54/113] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:10 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:11.191000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:11.191513 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:11.197497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:11.197971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:11.198396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:11.204990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:11.204990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:11.204990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:11.281879 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:11.283481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:11.292135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:11.293098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:11.295554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:11.296924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:11.297877 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:11.298460 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:11.378916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:11.386252 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-be723fc9-99fc-4a0a-addd-4cb2b3d116fa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.199292 Aug 06 22:11:11.387013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 60/114] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:11 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:11.478511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:11.487735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:11.489589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:11.490714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-70eff2e1-068a-4f88-b18c-7e776d04f9f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.218345 Aug 06 22:11:11.507059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 55/115] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:11 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:11.865586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:11.866206 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:11.875525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:11.875525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:11.875525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:11.875525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:11.875864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:11.875864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:12.032880 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:12.040267 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a8eabdfe-574e-4e33-b152-870aa90f6e63 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.178627 Aug 06 22:11:12.040852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 61/116] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:11 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:12.411219 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:12.411894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:12.417869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:12.418421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:12.419160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:12.420108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:12.420658 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:12.421151 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:12.515630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:12.516979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:12.527315 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:12.528944 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:12.529892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:12.531677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:12.541360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:12.541360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:12.572718 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:12.580879 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-56a5537b-dea3-45f1-a93f-24890b6a7b73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.173544 Aug 06 22:11:12.593011 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 56/117] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:12 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:12.692001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:12.700364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:12.701881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:12.702967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3b320b11-0a15-4d66-825c-e1cc8a307668 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.192770 Aug 06 22:11:12.703502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 62/118] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:12 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:13.060752 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:13.061632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:13.070839 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:13.071413 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:13.071903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:13.072841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:13.073349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:13.073828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:13.217043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:13.224283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0b8e017b-575c-4e3b-8db9-58a6d25e0249 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.167990 Aug 06 22:11:13.224868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 57/119] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:13 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:13.602848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:13.603536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:13.610118 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:13.610594 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:13.611187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:13.612065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:13.616617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:13.616617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:13.727952 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:13.729202 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:13.736374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:13.736955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:13.737448 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:13.738207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:13.738767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:13.739245 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:13.809682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:13.829411 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8c0f26be-b410-4f89-ad9f-c01f5f253b7d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.230696 Aug 06 22:11:13.832461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 63/120] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:13 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:13.931180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:13.940875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:13.942907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:13.944022 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1aa85d43-8d26-4489-ae0e-912152c75ff7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.222229 Aug 06 22:11:13.944620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 58/121] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:13 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:14.246381 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:14.247936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:14.253869 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:14.254345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:14.254768 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:14.255443 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:14.256110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:14.256502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:14.391263 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:14.398941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e704af7f-71be-432c-a6a2-55235d5df4a0 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.156733 Aug 06 22:11:14.399830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 64/122] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:14 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:14.858715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:14.858715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:14.863889 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:14.864479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:14.865028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:14.866008 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:14.866647 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:14.867271 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:14.967513 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:14.968177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:14.978162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:14.978650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:14.979132 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:14.979756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:14.980370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:14.981160 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:15.031013 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:15.039728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-48cfaa53-309f-4ac7-b737-fbe5edb0d443 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.189431 Aug 06 22:11:15.040297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 59/123] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:14 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:15.144054 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:15.152637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:15.155289 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:15.156595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e32d5549-f043-44d1-adb2-6c3d519cda40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.193364 Aug 06 22:11:15.157145 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 65/124] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:14 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:15.421579 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:15.422174 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:15.429218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:15.429218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:15.429218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:15.429508 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:15.429958 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:15.430371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:15.574473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:15.583129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-70dadae1-f011-4d91-bf08-e925d2c1cadf tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.165931 Aug 06 22:11:15.583722 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 60/125] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:15 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:16.060285 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:16.060922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:16.067768 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:16.068529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:16.069155 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:16.069858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:16.070506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:16.070925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:16.186351 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:16.189294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:16.203662 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:16.204149 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:16.204619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:16.208895 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:16.210613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:16.211446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:16.212066 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:16.220964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b1282248-ee9c-4c22-afce-b0de5d7082d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.164235 Aug 06 22:11:16.236468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 66/126] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:16 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:16.365189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:16.373416 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:16.374869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:16.376017 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-aa2c6c89-e1f9-4329-ba77-9f95e92f9400 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.200894 Aug 06 22:11:16.376591 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 61/127] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:16 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:16.604575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:16.605182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:16.611382 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:16.611865 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:16.613165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:16.613165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:16.613447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:16.613869 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:16.760184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:16.778241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a7ebf402-fbd4-46d3-95c6-89ae8796aa85 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.171877 Aug 06 22:11:16.778241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 67/128] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:16 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:17.245001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:17.245607 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:17.252321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:17.252832 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:17.253260 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:17.253951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:17.254395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:17.254813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:17.398392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:17.399062 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:17.405214 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:17.406896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:17.407389 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:17.407825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:17.408819 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:17.409424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:17.410507 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:17.412619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-271f1507-e434-4945-8320-6190aa09955c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.171304 Aug 06 22:11:17.413175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 62/129] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:17 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:17.543213 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:17.554511 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:17.556058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:17.557186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bc48f237-04b8-4c09-ae96-766d1694b58e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.162875 Aug 06 22:11:17.558250 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 68/130] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:17 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:17.803405 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:17.804039 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:17.810147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:17.810619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:17.811172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:17.811864 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:17.812316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:17.812788 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:18.022835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:18.030946 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a42b54b7-5f45-4cf9-9f35-d31e3a5f9318 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.231451 Aug 06 22:11:18.031516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 63/131] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:17 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:18.433175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:18.433785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:18.440117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:18.440630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:18.441054 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:18.441734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:18.442181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:18.442650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:18.581394 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:18.581925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:18.582133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:18.588788 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:18.589270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:18.589868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:18.591295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-688fed19-e1f0-4a82-8dd5-e3318ff19f57 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.161263 Aug 06 22:11:18.591900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:18.592366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:18.593002 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:18.604686 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 69/132] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:18 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:18.744874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:18.753732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:18.755220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:18.756312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8566713c-e8ee-4117-8608-abc96e1f44e1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.179001 Aug 06 22:11:18.756885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 64/133] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:18 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:19.053525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:19.054182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:19.060353 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:19.060871 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:19.061745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:19.062287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:19.062739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:19.063479 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:19.229295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:19.237698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0090a158-5b5a-43b1-97e0-3efe6d36d2e5 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.188271 Aug 06 22:11:19.238480 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 70/134] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:19 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:19.616131 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:19.616759 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:19.623484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:19.623959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:19.624382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:19.625293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:19.625739 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:19.626160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:19.770305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:19.780520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f622b587-00e5-483d-9025-74d90a32642b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.168118 Aug 06 22:11:19.782533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:19.783237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 65/135] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:19 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:19.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:19.791238 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:19.791758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:19.792332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:19.793427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:19.794150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:19.794699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:19.932506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:19.934802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:19.939900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:19.941442 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:19.942585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f0babaac-9f62-4b5c-bfe6-b7f51576c28c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.167339 Aug 06 22:11:19.943143 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 71/136] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:19 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:20.262411 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:20.263891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:20.270937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:20.271525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:20.272110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:20.272886 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:20.273431 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:20.273909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:20.408383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:20.416616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0e618879-cb7d-4cde-a963-1e0db93de27f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.158662 Aug 06 22:11:20.417250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 66/137] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:20 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:20.803033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:20.803766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:20.810052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:20.810681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:20.811220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:20.811965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:20.812552 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:20.813053 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:20.966941 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:20.968382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:20.975557 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:20.978368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:20.978818 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:20.982392 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:20.982392 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:20.982392 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:20.987580 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:20.997041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6202d993-fe0b-4174-baf3-834f8b62a7ac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.197815 Aug 06 22:11:20.998216 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 72/138] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:20 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:21.141424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:21.150958 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:21.152496 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:21.153877 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7f523f9f-4c46-4936-a33c-707b9d3bd2ef tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.193434 Aug 06 22:11:21.154902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 67/139] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:20 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:21.439308 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:21.439952 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:21.446363 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:21.446851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:21.447281 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:21.448006 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:21.448478 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:21.448899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:21.599262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:21.608088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f2d406fe-c85f-475d-90ba-01dbc36fbe93 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.173186 Aug 06 22:11:21.609198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 73/140] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:21 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:22.019098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:22.019802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:22.034479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:22.034479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:22.034479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:22.034479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:22.034853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:22.034853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:22.059817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:22.176781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:22.177007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:22.177810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:22.185904 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f64e8d41-6fd9-48d8-9fcd-01ec91f62249 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.170858 Aug 06 22:11:22.186555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 68/141] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:22 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:22.188028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:22.188688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:22.189140 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:22.189858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:22.190310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:22.190764 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:22.323797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:22.332436 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:22.333908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:22.334992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3256efdf-2796-4c8c-a29f-455951f14508 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.162437 Aug 06 22:11:22.335742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 74/142] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:22 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:22.629091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:22.629721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:22.636071 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:22.636573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:22.637079 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:22.637793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:22.638295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:22.638710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:22.812565 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:22.820469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-446bdb08-6fc5-4677-8a09-193ced688774 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.195134 Aug 06 22:11:22.821046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 69/143] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:22 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:23.213719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:23.218629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:23.229091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:23.230551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:23.231181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:23.234635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:23.235030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:23.235465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:23.360615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:23.361938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:23.368848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:23.369334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:23.369763 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:23.370454 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:23.370900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:23.372151 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:23.478971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:23.487645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f78def8d-1ac4-4c29-ac7e-572c0d767972 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.283690 Aug 06 22:11:23.488435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 75/144] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:23 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:23.541139 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:23.550463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:23.551991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:23.553134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-16181236-83c4-47ea-b74a-97d75191d478 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.198692 Aug 06 22:11:23.553722 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 70/145] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:23 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:23.842413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:23.843148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:23.849782 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:23.850359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:23.851335 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:23.852204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:23.852789 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:23.853303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:24.035050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:24.056090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3bc862db-d263-4c58-bc8a-c5b009cddff1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.218234 Aug 06 22:11:24.062878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 76/146] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:23 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:24.294105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-2c20f000-b37a-4dc5-bb75-b01392792345 req-8170e7ae-6a02-4c33-9e1a-ed5c30763033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7471b413-f47d-4f7a-a2f8-1e4131d39531", "name": "network-vif-plugged", "status": "completed", "tag": "04fbb9fe-cdaf-4773-ae55-3a9eb80e33a0"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:24.306299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2c20f000-b37a-4dc5-bb75-b01392792345 req-8170e7ae-6a02-4c33-9e1a-ed5c30763033 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:24.306764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2c20f000-b37a-4dc5-bb75-b01392792345 req-8170e7ae-6a02-4c33-9e1a-ed5c30763033 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:24.307188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2c20f000-b37a-4dc5-bb75-b01392792345 req-8170e7ae-6a02-4c33-9e1a-ed5c30763033 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:24.326770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-2c20f000-b37a-4dc5-bb75-b01392792345 req-8170e7ae-6a02-4c33-9e1a-ed5c30763033 service nova] Creating event network-vif-plugged:04fbb9fe-cdaf-4773-ae55-3a9eb80e33a0 for instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 on hv-cinder-84984 Aug 06 22:11:24.332580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2c20f000-b37a-4dc5-bb75-b01392792345 req-8170e7ae-6a02-4c33-9e1a-ed5c30763033 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 22:11:24.332580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2c20f000-b37a-4dc5-bb75-b01392792345 req-8170e7ae-6a02-4c33-9e1a-ed5c30763033 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 22:11:24.332580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:24.332580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:24.332580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:24.332995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:24.332995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:24.332995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:24.341741 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.compute.rpcapi [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 22:11:24.342613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] Releasing lock "compute-rpcapi-router" {{(pid=118456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 22:11:24.365279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f16a5e85-2266-464e-b7fc-6e50943d2e57 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130287 Aug 06 22:11:24.366468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 71/147] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:24.583741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:24.583741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:24.583741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:24.583741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:24.587210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:24.587210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:24.587210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:24.587210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:24.588234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:24.588234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:24.588234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:24.588993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:24.588993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:24.589433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:24.590427 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:24.591066 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:24.818774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:24.818774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a71b6646-a05e-4d38-b170-cef84b0c7f20 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.198970 Aug 06 22:11:24.818774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 77/148] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:24 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:24.819041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:24.819041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:24.819229 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:24.819229 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ab5a3c3f-f49a-4766-b74c-d8247f1d9e4b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.180049 Aug 06 22:11:24.819229 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 72/149] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:24 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:25.083298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:25.083902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:25.090040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:25.090515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:25.090945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:25.091623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:25.092072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:25.092565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:25.232444 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:25.239153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c494f345-27ae-4631-8696-59891cacc3af tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.159775 Aug 06 22:11:25.239717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 78/150] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:25 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:25.790428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:25.792587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:25.800577 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:25.806399 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:25.817444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:25.819739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:25.820461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:25.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:25.822665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:25.823023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:25.823924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:25.825516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:25.826281 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:25.826702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:25.827280 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:25.827664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:26.149522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:26.149661 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:26.154083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:26.155566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:26.156759 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1300bad1-46ec-4b3a-ac0a-6826e9df4f31 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.370216 Aug 06 22:11:26.157310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 79/151] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:25 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:26.157585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1c06865c-53eb-456f-ab14-211e0f21b037 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.374398 Aug 06 22:11:26.158321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 73/152] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:25 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:26.261922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:26.262626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:26.269110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:26.269605 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:26.273669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:26.273669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:26.273669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:26.273669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:26.408784 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:26.416481 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-720437ec-e277-460a-b4e6-4d8a6d0af8ef tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.158514 Aug 06 22:11:26.417269 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 80/153] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:26 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:27.180696 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:27.181259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:27.181642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:27.181741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:27.188375 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:27.188558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:27.188923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:27.189115 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:27.189356 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:27.189686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:27.190048 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:27.190486 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:27.190583 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:27.190907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:27.191091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:27.191742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:27.411602 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:27.424165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:27.429821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-39cd1369-a389-40d7-822d-41f523a559cd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.253047 Aug 06 22:11:27.433660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 74/154] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:27 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:27.433889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:27.435142 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:27.436324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-72bf1f5a-d359-42a0-9cb9-64a7d55cab63 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.259206 Aug 06 22:11:27.436981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 81/155] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:27 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:27.439227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:27.439831 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:27.445879 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:27.446588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:27.447555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:27.448971 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:27.450681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:27.451295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:27.597621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:27.605301 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5c8a0e02-6022-4df1-a999-40c3dd740e81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.169960 Aug 06 22:11:27.605866 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 75/156] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:27 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:28.454746 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:28.455283 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:28.462608 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:28.463511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:28.473782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.474355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.474999 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.476942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.477919 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.478467 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.478978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.479502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.479952 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.480907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.481501 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.482096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.728671 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:28.741181 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:28.743951 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-41c2b5dd-9d20-4a67-b987-61a771daa9bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.295995 Aug 06 22:11:28.744521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 82/157] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:28 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:28.754346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:28.754928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:28.755831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:28.755988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:28.760349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-13c11abc-3ede-46df-907a-85db0a42e6ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.303070 Aug 06 22:11:28.763829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 76/158] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:28 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:28.764018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.764641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.766098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.766986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.767651 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.768563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.916750 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:28.924936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-51bba344-e027-4152-974b-8811918a998e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.178980 Aug 06 22:11:28.926949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 83/159] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:28 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:29.764454 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:29.765062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:29.770908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:29.771381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:29.771827 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:29.772508 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:29.772950 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:29.773364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:29.791679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:29.791679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:29.796017 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:29.796515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:29.797140 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:29.797981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:29.798430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:29.798848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:29.997973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:30.007892 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bb8b3a43-978e-4fb0-97c3-2197ee696ea6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.247266 Aug 06 22:11:30.008955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 77/160] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:29 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:30.015623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:30.016517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:30.023428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:30.024211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:30.024880 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:30.025728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:30.038331 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:30.038331 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:30.038331 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:30.038803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:30.038803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:30.038803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0418618b-dfaa-477a-8b6e-6c10390a7a02 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.254873 Aug 06 22:11:30.039056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 84/161] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:29 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:30.175511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:30.183031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-161cf1d9-487f-49d4-afce-6e8ff9508c81 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.171332 Aug 06 22:11:30.184467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 78/162] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:30 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:31.032166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:31.032794 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:31.034679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=82 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:31.039634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:31.040113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:31.040662 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:31.041217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:31.041656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:31.042065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:31.061769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:31.062981 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:31.068376 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=80 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:31.069998 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:31.070676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:31.071169 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:31.071955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:31.072492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:31.073004 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:31.251282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:31.259732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f5599f7f-18df-4f18-be79-7fb769e2822a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.231341 Aug 06 22:11:31.260598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 85/163] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:31 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:31.261099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:31.266765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:31.267580 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:31.273579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:31.273724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:31.274364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:31.274804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:31.275484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:31.275599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:31.275970 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:31.276388 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:31.277093 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7f872bd1-78ab-4f6e-a92b-7698b2b1d537 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.220340 Aug 06 22:11:31.278449 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 79/164] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:31 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:31.417050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:31.424680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d8129095-7ec9-4aae-ba93-e1d9785cad88 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.162048 Aug 06 22:11:31.425435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 86/165] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:31 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:32.118484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-a6f4dcf0-7332-4c4e-a081-47d217983b1f req-eaae23bb-36e5-4f43-906c-b7c709f8ddfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209d7c8e-59b6-4313-a518-a2c8c7eeb290", "name": "network-vif-plugged", "status": "completed", "tag": "608fc1c7-cd79-4b52-883b-01561aed2ea4"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:32.135734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-a6f4dcf0-7332-4c4e-a081-47d217983b1f req-eaae23bb-36e5-4f43-906c-b7c709f8ddfe service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:32.135852 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-a6f4dcf0-7332-4c4e-a081-47d217983b1f req-eaae23bb-36e5-4f43-906c-b7c709f8ddfe service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:32.136221 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-a6f4dcf0-7332-4c4e-a081-47d217983b1f req-eaae23bb-36e5-4f43-906c-b7c709f8ddfe service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:32.151558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-a6f4dcf0-7332-4c4e-a081-47d217983b1f req-eaae23bb-36e5-4f43-906c-b7c709f8ddfe service nova] Creating event network-vif-plugged:608fc1c7-cd79-4b52-883b-01561aed2ea4 for instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 on hv-cinder-84984 Aug 06 22:11:32.161609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-a6f4dcf0-7332-4c4e-a081-47d217983b1f req-eaae23bb-36e5-4f43-906c-b7c709f8ddfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050021 Aug 06 22:11:32.162397 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 80/166] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:32.282202 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:32.282813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:32.288873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:32.289359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:32.289799 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:32.290491 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:32.290946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:32.291374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:32.302006 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:32.302697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:32.309265 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:32.309778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:32.310396 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:32.311103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:32.311560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:32.311982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:32.506875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:32.510316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:32.514727 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0a6a7614-7239-49e7-baa4-cc8571093709 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.237568 Aug 06 22:11:32.520502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 87/167] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:32 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:32.520622 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:32.520753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:32.520753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:32.521641 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:32.522878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ca88b695-0bf9-410d-88ad-11fc74132f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.225042 Aug 06 22:11:32.523644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 81/168] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:32 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:32.526260 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:32.527341 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:32.528121 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:32.528945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:32.529486 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:32.529963 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:32.548513 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:32.662967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:32.670560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3ee38871-628b-4576-ab4e-7520af61f05a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.154349 Aug 06 22:11:32.674961 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 88/169] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:32 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:33.536430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:33.537942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:33.548250 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:33.548250 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:33.554817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.555310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.555740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.557044 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.557044 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.557355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.576375 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.582572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.582572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.582572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.582572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.582917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.783828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:33.787977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:33.792140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c089e79d-30b8-412b-baf6-7fcec9061016 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.259576 Aug 06 22:11:33.796448 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 82/170] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:33 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:33.798272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:33.799799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:33.799984 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:33.806706 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:33.807989 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5f07c65a-8de6-45f5-9091-19e4a77b43ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.265594 Aug 06 22:11:33.811387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.811387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.811611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 89/171] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:33 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:33.811700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.811700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.811700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.811700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:34.004691 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:34.012610 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-14ed8b11-f052-4627-a9b1-f8ed3064b6ff tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1313 microversion: 2.1 time: 0.217810 Aug 06 22:11:34.013183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 83/172] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:33 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:34.814201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:34.814808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:34.821894 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:34.822929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:34.823755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:34.824782 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:34.825776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:34.826466 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:34.835295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:34.835823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:34.842367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:34.844213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:34.844763 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:34.845199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:34.846127 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:34.846587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:34.847008 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:35.048899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:35.058458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-de73bee3-0a96-4e8b-8cc8-218a18c74e1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.248318 Aug 06 22:11:35.059541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 90/173] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:34 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:35.064724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:35.066030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:35.067166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:35.072900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:35.074495 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:35.075217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:35.075325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:35.076030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:35.076344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2317636c-cb10-4936-8c62-9e1e8c671a08 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.246665 Aug 06 22:11:35.079514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:35.080252 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:35.081149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:35.089055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 84/174] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:34 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:35.230776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:35.238457 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2a8e35bc-74af-4a86-97ba-0825e8b8130c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1500 microversion: 2.1 time: 0.177767 Aug 06 22:11:35.239057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 91/175] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:35 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1500 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:36.082375 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:36.083011 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:36.088907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:36.089464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:36.089854 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:36.090549 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:36.090997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:36.091416 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:36.101383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:36.103301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:36.109987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:36.110498 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:36.110933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:36.112889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:36.113508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:36.114078 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:36.319682 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:36.328246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-142fbb18-d192-4545-9670-48626992af81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.249996 Aug 06 22:11:36.341605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 85/176] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:36 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:36.344382 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:36.360340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:36.363847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:36.363847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6b49d741-8ac0-42a6-85ec-271cf97f7ebf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.267805 Aug 06 22:11:36.363847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 92/177] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:36 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:37.349113 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:37.350449 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:37.357509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:37.357994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:37.358556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:37.359250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:37.359708 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:37.360124 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:37.364622 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:37.387103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:37.387700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:37.394093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:37.394567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:37.394992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:37.395705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:37.396149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:37.396613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:37.540461 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:37.549605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4ae6afb8-07d9-43c4-a446-ab92c2a2297e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.204397 Aug 06 22:11:37.550398 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 86/178] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:37 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:37.571400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:37.580202 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:37.581731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:37.582820 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3a6d8ef0-95e1-449c-b092-f9e45f2c1c14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.200392 Aug 06 22:11:37.583382 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 93/179] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:37 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:38.571010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:38.571621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:38.578699 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:38.579176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:38.579595 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:38.580274 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:38.580740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:38.581149 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:38.606146 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:38.606739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:38.612858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:38.613338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:38.613769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:38.614639 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:38.615112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:38.615515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:38.829376 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:38.837819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a40030c3-2d8e-447c-b8ca-133ef89e0057 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.270560 Aug 06 22:11:38.838817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 87/180] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:38 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:38.859947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:38.868879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:38.870540 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:38.871748 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-aa2fe65d-7d9d-4eee-9348-2fcc01408132 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.269780 Aug 06 22:11:38.872313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 94/181] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:38 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:39.860002 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:39.860643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:39.866588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:39.867204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:39.867548 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:39.868231 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:39.868771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:39.870292 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:39.906572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:39.907359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:39.913516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:39.916220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:39.916220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:39.916220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:39.916220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:39.916601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:40.056174 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:40.063934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f8b3ff40-1c2b-4059-9bdf-123ce358e049 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.207856 Aug 06 22:11:40.064528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 88/182] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:39 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:40.086626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:40.095085 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:40.096608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:40.097800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-51d39d93-5150-4a95-8610-652afe392aeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1405 microversion: 2.20 time: 0.196048 Aug 06 22:11:40.098451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 95/183] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:39 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:11:40.896328 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-cd562a10-7be1-4730-a9b6-dcf7b16e6a9b req-4d853748-bc81-4edf-a185-07ac0d6a51f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56213f38-4e86-47ad-b1df-7734464598ed", "name": "network-vif-plugged", "status": "completed", "tag": "bac5d3c4-a8bf-4af4-a8c0-f09c5503cf0f"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:40.905714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-cd562a10-7be1-4730-a9b6-dcf7b16e6a9b req-4d853748-bc81-4edf-a185-07ac0d6a51f1 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:40.906185 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-cd562a10-7be1-4730-a9b6-dcf7b16e6a9b req-4d853748-bc81-4edf-a185-07ac0d6a51f1 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:40.906612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-cd562a10-7be1-4730-a9b6-dcf7b16e6a9b req-4d853748-bc81-4edf-a185-07ac0d6a51f1 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:40.917821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-cd562a10-7be1-4730-a9b6-dcf7b16e6a9b req-4d853748-bc81-4edf-a185-07ac0d6a51f1 service nova] Creating event network-vif-plugged:bac5d3c4-a8bf-4af4-a8c0-f09c5503cf0f for instance 56213f38-4e86-47ad-b1df-7734464598ed on hv-cinder-84984 Aug 06 22:11:40.922861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-cd562a10-7be1-4730-a9b6-dcf7b16e6a9b req-4d853748-bc81-4edf-a185-07ac0d6a51f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030239 Aug 06 22:11:40.923429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 89/184] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:41.085578 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:41.086190 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:41.092594 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:41.093080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:41.093534 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:41.094223 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:41.094676 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:41.095098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:41.124078 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:41.125378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:41.131295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:41.131807 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:41.132234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:41.132987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:41.133432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:41.133845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:41.293288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:41.317953 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-414f643f-d20f-4c6b-a298-5b4deb1b629d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.236295 Aug 06 22:11:41.318742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 96/185] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:41 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:41.332084 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:41.367977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:41.369707 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:41.370902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e2bd56cf-70f3-4860-8fce-0d9028eac8ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1598 microversion: 2.20 time: 0.252380 Aug 06 22:11:41.371441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 90/186] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:11:41 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1598 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:11:41.396149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:41.396149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:41.403257 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:41.403905 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:41.404539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:41.405424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:41.405872 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:41.406447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:41.534698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b2f91e8a-00b6-4c1a-8cf4-7d11774f62a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.142856 Aug 06 22:11:41.539728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 97/187] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Aug 6 22:11:41 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:11:41.856123 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03d5b89e-9e7a-4ff2-91c9-dfe20f46bd7a"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:41.859904 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:41.867358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:41.867840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:41.868366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:41.869131 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:41.869580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:41.870186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:42.343530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:42.344772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:42.351503 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:42.352207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:42.352660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:42.353425 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:42.353869 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:42.354480 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:42.543172 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:42.556385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8418c9b5-47d3-460a-b951-73ba39ef4170 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.213257 Aug 06 22:11:42.560109 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 98/188] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:42 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:42.630628 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-321369943", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "networks": [{"uuid": "aa8633b3-8e9c-4003-b8c9-09a0704a5ffb"}]}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:42.715051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] validate_networks() for [('aa8633b3-8e9c-4003-b8c9-09a0704a5ffb', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:11:43.357465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:11:43.357999 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:11:43.358314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:11:43.358957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:11:43.360001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:11:43.369574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:43.370985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:43.371631 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:43.372611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:43.373272 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:43.373908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:43.399137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Getting quotas for project 6cc6b84f1fcc4e28b7c3a7547b6640b8. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:11:43.399137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Getting quotas for user 26b6e4a0640548dd8d6bb800d1f26b95 and project 6cc6b84f1fcc4e28b7c3a7547b6640b8. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:11:43.411319 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:11:43.413648 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:11:43.508306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-79b5d036-1173-41ed-ac3a-6c45edb2d475 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "POST /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.656445 Aug 06 22:11:43.516593 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 91/189] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:11:41 2022] POST /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531/os-volume_attachments => generated 194 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:43.549544 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-538d3398-44fd-4fba-b9d0-0b15b0d62bdc req-307f1195-e761-4794-b0c3-d529d150c6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209d7c8e-59b6-4313-a518-a2c8c7eeb290", "tag": "608fc1c7-cd79-4b52-883b-01561aed2ea4"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:43.563850 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a0fc3c5b-8ac4-413f-926d-fadce123c646 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937778 Aug 06 22:11:43.575832 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 99/190] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:11:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 22:11:43.587135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-538d3398-44fd-4fba-b9d0-0b15b0d62bdc req-307f1195-e761-4794-b0c3-d529d150c6df service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:43.588907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c1d5265f-ec1f-4e64-864b-393d59a14f67 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:43.589681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-538d3398-44fd-4fba-b9d0-0b15b0d62bdc req-307f1195-e761-4794-b0c3-d529d150c6df service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:43.590293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-538d3398-44fd-4fba-b9d0-0b15b0d62bdc req-307f1195-e761-4794-b0c3-d529d150c6df service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:43.593133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c1d5265f-ec1f-4e64-864b-393d59a14f67 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:43.619470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-538d3398-44fd-4fba-b9d0-0b15b0d62bdc req-307f1195-e761-4794-b0c3-d529d150c6df service nova] Creating event network-changed:608fc1c7-cd79-4b52-883b-01561aed2ea4 for instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 on hv-cinder-84984 Aug 06 22:11:43.627287 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-538d3398-44fd-4fba-b9d0-0b15b0d62bdc req-307f1195-e761-4794-b0c3-d529d150c6df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108703 Aug 06 22:11:43.628320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 92/191] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:43.638452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:43.639103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:43.661852 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:43.662840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:43.665330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:43.668465 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:43.668955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:43.669390 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:43.684438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c1d5265f-ec1f-4e64-864b-393d59a14f67 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:43.691809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c1d5265f-ec1f-4e64-864b-393d59a14f67 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1213 microversion: 2.1 time: 0.114546 Aug 06 22:11:43.692344 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 100/192] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:43 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:44.026157 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:44.034145 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d46fb0bb-214a-424c-a909-f77ffe31da01 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.404330 Aug 06 22:11:44.034712 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 93/193] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:43 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:44.714966 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7507fc6b-1726-4b62-949e-9d0ea36b6ab5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:44.716331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7507fc6b-1726-4b62-949e-9d0ea36b6ab5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:44.772568 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7507fc6b-1726-4b62-949e-9d0ea36b6ab5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:44.779432 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7507fc6b-1726-4b62-949e-9d0ea36b6ab5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1213 microversion: 2.1 time: 0.069067 Aug 06 22:11:44.780008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 101/194] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:44 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:45.055716 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:45.056350 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:45.062963 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:45.063438 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:45.063996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:45.064768 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:45.065215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:45.065628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:45.214474 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:45.222351 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7f4212e0-991b-460a-a0b3-a0360873f857 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.170525 Aug 06 22:11:45.223056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 94/195] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:45 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:45.803037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:45.804129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:45.812847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:45.813430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:45.813919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:45.814696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:45.815207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:45.815688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:45.887266 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:45.895208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-15da8525-04c8-4588-971f-a406990c043b tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1217 microversion: 2.1 time: 0.098606 Aug 06 22:11:45.895772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 102/196] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:45 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:46.249068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:46.249068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:46.253890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:46.254369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:46.254970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:46.255706 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:46.256269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:46.256634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:46.422437 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:46.430794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e0469d5a-0785-46e4-bf55-7b7fe258c59f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1366 microversion: 2.1 time: 0.187983 Aug 06 22:11:46.433599 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 95/197] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:46 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:46.916934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:46.918027 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:46.924106 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:46.924623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:46.925283 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:46.925987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:46.926699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:46.927000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:46.993990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:47.002222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-26756186-3458-4304-abea-51848a097ee2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1209 microversion: 2.1 time: 0.089150 Aug 06 22:11:47.009371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 103/198] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:46 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:47.451281 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:47.451888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:47.458328 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:47.458803 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:47.459327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:47.460010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:47.460477 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:47.460900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:47.593910 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:47.601675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e6ba8403-c949-40b9-92ae-722d0613c3bd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1556 microversion: 2.1 time: 0.154538 Aug 06 22:11:47.602228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 96/199] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:47 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:47.622446 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:47.622934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:47.628958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:47.629442 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:47.629873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:47.630560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:47.631007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:47.631431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:47.708859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9d18bb21-2adc-4efa-b2e9-25eb3af42979 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090241 Aug 06 22:11:47.709448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 104/200] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Aug 6 22:11:47 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:48.035531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:48.036141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:48.042862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:48.043668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:48.044159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:48.044968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:48.045617 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:48.046105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:48.232595 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:48.241902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-01afc7ea-62ac-4ca2-bcda-459a84a0459d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1265 microversion: 2.1 time: 0.210795 Aug 06 22:11:48.256163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 97/201] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:48 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:48.901435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-f13c877b-f278-4ee0-b7bc-55d275593c8f req-c8ff734b-193a-4845-b330-c25c18d4bdbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56213f38-4e86-47ad-b1df-7734464598ed", "tag": "bac5d3c4-a8bf-4af4-a8c0-f09c5503cf0f"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:48.914143 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f13c877b-f278-4ee0-b7bc-55d275593c8f req-c8ff734b-193a-4845-b330-c25c18d4bdbb service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:48.925113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f13c877b-f278-4ee0-b7bc-55d275593c8f req-c8ff734b-193a-4845-b330-c25c18d4bdbb service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:48.925113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f13c877b-f278-4ee0-b7bc-55d275593c8f req-c8ff734b-193a-4845-b330-c25c18d4bdbb service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:48.934254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-f13c877b-f278-4ee0-b7bc-55d275593c8f req-c8ff734b-193a-4845-b330-c25c18d4bdbb service nova] Creating event network-changed:bac5d3c4-a8bf-4af4-a8c0-f09c5503cf0f for instance 56213f38-4e86-47ad-b1df-7734464598ed on hv-cinder-84984 Aug 06 22:11:48.940575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-f13c877b-f278-4ee0-b7bc-55d275593c8f req-c8ff734b-193a-4845-b330-c25c18d4bdbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044755 Aug 06 22:11:48.945357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 105/202] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:49.263813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:49.264387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:49.283737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:49.284573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:49.285016 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:49.285727 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:49.286557 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:49.287134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:49.390638 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:49.400348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0fd50efb-b3cb-4ed3-bf14-355d52d94557 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1283 microversion: 2.1 time: 0.141094 Aug 06 22:11:49.402327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 98/203] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:49 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1283 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:50.424208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:50.424941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:50.431066 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:50.431540 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:50.431977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:50.436908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:50.436908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:50.436908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:50.480447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-367427320", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "networks": [{"uuid": "f2844852-f7dd-4a0c-bd33-cc6777d6e26c"}]}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:50.539845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] validate_networks() for [('f2844852-f7dd-4a0c-bd33-cc6777d6e26c', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:11:50.645255 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:50.653616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-04127965-e0b8-402f-9d76-ab3df6f458cc tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.233581 Aug 06 22:11:50.654181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 106/204] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:50 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:50.938207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:11:50.938652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:11:50.939117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:11:50.939537 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:11:50.940917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:11:50.950327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:50.950798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:50.951256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:50.951968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:50.952584 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:50.953018 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:50.970885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Getting quotas for project dc2fb805386743d1a4bfd3b15bde695c. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:11:50.974820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Getting quotas for user 56138f43f00e46ea9dda399a0fb0e822 and project dc2fb805386743d1a4bfd3b15bde695c. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:11:50.986350 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:11:50.988616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:11:51.129877 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bcdff841-7f58-4e7f-ab5b-806c715706e7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654280 Aug 06 22:11:51.130517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 99/205] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:11:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 22:11:51.142140 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0205423f-f51e-4a60-b768-02d43c2a9a10 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:51.142786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0205423f-f51e-4a60-b768-02d43c2a9a10 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:51.196476 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0205423f-f51e-4a60-b768-02d43c2a9a10 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:51.216464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0205423f-f51e-4a60-b768-02d43c2a9a10 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1218 microversion: 2.1 time: 0.065701 Aug 06 22:11:51.216464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 107/206] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:51 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:51.678261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:51.686057 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:51.693799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:51.694475 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:51.694908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:51.695703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:51.696043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:51.696489 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:51.838400 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:51.847261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8ae9abd7-8644-4aac-b835-73f18e2efa51 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.176128 Aug 06 22:11:51.847985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 100/207] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:51 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:52.224916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e02e8b24-b417-44b0-a2f9-dd574524b99e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:52.225519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e02e8b24-b417-44b0-a2f9-dd574524b99e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:52.277908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e02e8b24-b417-44b0-a2f9-dd574524b99e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:52.285381 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e02e8b24-b417-44b0-a2f9-dd574524b99e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1218 microversion: 2.1 time: 0.064321 Aug 06 22:11:52.285934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 108/208] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:52 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:52.869222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:52.869802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:52.876819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:52.877298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:52.877731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:52.878414 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:52.878888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:52.879304 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:53.011697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:53.019135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a1b29c81-c4d8-4fcf-b1ea-17829095c87d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.153732 Aug 06 22:11:53.019690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 101/209] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:52 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:53.306483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:53.307014 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:53.313090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:53.313568 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:53.313991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:53.314665 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:53.315113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:53.315530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:53.377531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:53.383259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:53.385788 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ad6808f3-386f-4794-8d8e-806f24f8e048 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1222 microversion: 2.1 time: 0.083239 Aug 06 22:11:53.386349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 109/210] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:53 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:54.038913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:54.039522 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:54.046313 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:54.046797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:54.047234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:54.047924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:54.048373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:54.048822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:54.180412 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:54.185800 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-43bda6cd-32ca-4123-9b4a-9585b6bd016e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.150733 Aug 06 22:11:54.186372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 102/211] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:54 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:54.405497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:54.406183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:54.412860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:54.413341 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:54.413767 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:54.414444 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:54.414885 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:54.415298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:54.474925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:54.482933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6c22f3df-5f4e-4e21-9742-04f902983635 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1222 microversion: 2.1 time: 0.081463 Aug 06 22:11:54.483496 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 110/212] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:54 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:55.206816 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:55.207423 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:55.213962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:55.214452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:55.214979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:55.215635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:55.216080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:55.216525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:55.235257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:55.360340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-2bc3624b-a102-440f-86fd-2772650febbb req-5c869a06-a9a4-48fd-8696-0159b40ee7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391d123e-483c-4cf0-96e3-f80acc6140c1", "tag": "fa3ba80d-c57d-4032-8c76-232d92ebb02e"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:55.362314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:55.379525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7cd46fff-9eed-4e9f-a86d-f594cb3652b5 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.176544 Aug 06 22:11:55.380368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 103/213] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:55 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:55.392970 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-2bc3624b-a102-440f-86fd-2772650febbb req-5c869a06-a9a4-48fd-8696-0159b40ee7ce service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:55.393473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-2bc3624b-a102-440f-86fd-2772650febbb req-5c869a06-a9a4-48fd-8696-0159b40ee7ce service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:55.393919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-2bc3624b-a102-440f-86fd-2772650febbb req-5c869a06-a9a4-48fd-8696-0159b40ee7ce service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:55.398249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:55.405242 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-2bc3624b-a102-440f-86fd-2772650febbb req-5c869a06-a9a4-48fd-8696-0159b40ee7ce service nova] Creating event network-changed:fa3ba80d-c57d-4032-8c76-232d92ebb02e for instance 391d123e-483c-4cf0-96e3-f80acc6140c1 on hv-cinder-84984 Aug 06 22:11:55.409856 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-2bc3624b-a102-440f-86fd-2772650febbb req-5c869a06-a9a4-48fd-8696-0159b40ee7ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059423 Aug 06 22:11:55.410420 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 111/214] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:55.504730 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:55.505332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:55.511383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:55.511850 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:55.512275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:55.512983 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:55.513422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:55.513842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:55.574773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:55.582452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c073eaaf-13d5-49fc-80ca-518752d9e728 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1222 microversion: 2.1 time: 0.081866 Aug 06 22:11:55.583154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 104/215] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:55 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:56.400492 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:56.403915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:56.407897 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:56.408370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:56.408826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:56.409508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:56.409960 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:56.410649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:56.549023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:56.556533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-803b3675-ff13-4f37-9068-b124a2c6e5f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.160598 Aug 06 22:11:56.557200 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 112/216] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:56 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:56.603905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:56.604606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:56.611197 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:56.611678 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:56.612155 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:56.612797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:56.613246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:56.613657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:56.681848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:56.689880 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1bb5a212-1909-4d4d-afde-8a4ad51c8c2b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1222 microversion: 2.1 time: 0.090302 Aug 06 22:11:56.690426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 105/217] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:56 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:57.577287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:57.577910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:57.583825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:57.584303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:57.584772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:57.585454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:57.585902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:57.586434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:57.713056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:57.725121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:57.725121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:57.725121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:57.725121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:57.725940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:57.725940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:57.725940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:57.769411 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:57.784068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ed8f0caa-dd74-4e7b-863f-fb4cfb29132c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.207933 Aug 06 22:11:57.784736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 113/218] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:57 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:57.800085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:57.810177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f936ea36-155e-4723-adc8-0307b8277a15 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1214 microversion: 2.1 time: 0.102964 Aug 06 22:11:57.811030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 106/219] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:57 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:58.805453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:58.806054 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:58.812815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:58.813294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:58.813722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:58.814395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:58.814889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:58.815302 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:58.840776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:58.840776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:58.842912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:58.844431 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:58.845077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:58.846167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:58.846892 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:58.847721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:58.950240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:58.970354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e0c73a19-5458-410a-94f0-3a511bf93bf5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1270 microversion: 2.1 time: 0.140872 Aug 06 22:11:58.971972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 107/220] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:58 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:58.979499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:58.980530 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:58.989052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:58.989944 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:58.990373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:58.991065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:58.991515 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:58.992061 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:59.020295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:11:59.028728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:59.037023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f39f7310-0415-411a-b194-ecdf6b89cffd tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.235236 Aug 06 22:11:59.038170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 114/221] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:58 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:59.366275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-79812a04-f675-4575-b3d3-3f16d1a21d4c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 204 len: 0 microversion: 2.1 time: 0.392606 Aug 06 22:11:59.366870 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 108/222] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:11:58 2022] DELETE /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:11:59.375130 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:59.375785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:59.381805 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:59.382258 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:59.382682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:59.383363 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:59.383806 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:59.384219 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:59.513968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:59.521853 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-514cbddf-5669-4c5a-85fe-5eef48f10605 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.150582 Aug 06 22:11:59.522421 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 115/223] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:59 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:59.994210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:59.994902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:00.001817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:00.002295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:00.002723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:00.003428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:00.003874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:00.004291 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:00.059927 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:00.061499 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:00.068333 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:00.069115 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:00.069804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:00.070713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:00.071522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:00.072153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:00.083786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:00.091483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-74e5a3dc-7baf-43c8-b9b9-5ae39c1557d4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1278 microversion: 2.1 time: 0.101258 Aug 06 22:12:00.092056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 109/224] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:59 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1278 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:00.227865 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:00.233624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2210d78d-254a-4cba-96cb-fa14eea91e22 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.179885 Aug 06 22:12:00.234177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 116/225] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:00 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:00.544804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:00.545335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:00.551292 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:00.551775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:00.552222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:00.552929 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:00.554600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:00.554600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:00.695088 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:00.703412 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5abfbc0f-4546-4a21-8119-aaba64bb6cbe tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.164083 Aug 06 22:12:00.704062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 110/226] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:00 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:01.113473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:01.114104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:01.119941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:01.120622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:01.121112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:01.121796 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:01.122241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:01.122660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:01.186566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:01.194023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-13cf9d36-89fb-44ac-948c-5b6eed70a622 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1278 microversion: 2.1 time: 0.084316 Aug 06 22:12:01.194574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 117/227] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:01 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:01.253689 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:01.254320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:01.256346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:01.257099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=6 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:01.263193 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:01.263661 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:01.264098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:01.264822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:01.265276 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:01.266105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:01.412145 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:01.420046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f54867d7-edc3-41eb-ac9a-87314066f81c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.170248 Aug 06 22:12:01.420635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 111/228] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:01 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:01.725456 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:01.726427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:01.733032 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:01.733516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:01.733951 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:01.734637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:01.735085 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:01.735509 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:01.890318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:01.898295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d48696d3-31a6-46c7-a636-bed46c33035a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.176766 Aug 06 22:12:01.898849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 118/229] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:01 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:02.214906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:02.215501 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:02.217908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:02.222792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:02.223266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:02.223692 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:02.224367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:02.224834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:02.225252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:02.291959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:02.299410 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ca32ea34-6c01-4e73-a224-c8aa95242582 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1288 microversion: 2.1 time: 0.088478 Aug 06 22:12:02.299974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 112/230] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:02 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:02.440966 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:02.441573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:02.443690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=14 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:02.444440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:02.451161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:02.451161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:02.451161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:02.451440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:02.451787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:02.452205 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:02.583439 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:02.591014 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bacfffe7-abe1-4d3a-860d-cb3f580208b2 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.153944 Aug 06 22:12:02.591582 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 119/231] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:02 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:02.920212 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:02.920889 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:02.927511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:02.927994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:02.928450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:02.929142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:02.929592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:02.930022 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:03.064959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:03.072855 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7e61bfd9-88d4-42ef-9f14-aab22b5286ad tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.157262 Aug 06 22:12:03.073563 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 113/232] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:02 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:03.327041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:03.327643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:03.335296 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:03.335778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:03.336211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:03.336985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:03.337435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:03.339053 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:03.409108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:03.422120 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3ee01f25-5b97-40e2-9382-5acb10332336 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1288 microversion: 2.1 time: 0.099486 Aug 06 22:12:03.422825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 120/233] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:03 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:03.611978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:03.613261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:03.622059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:03.641603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:03.641603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:03.641603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:03.641603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:03.642242 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:03.783129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:03.790894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-33cdfc0b-ffcc-41a0-8772-0fe279754849 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.183255 Aug 06 22:12:03.804916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 114/234] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:03 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:04.095677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:04.096890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:04.103477 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:04.103968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:04.104422 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:04.105503 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:04.105962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:04.106387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:04.266136 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:04.292771 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4c22ffc2-08da-4ec7-b595-51190d2cf76b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.200202 Aug 06 22:12:04.297354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 121/235] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:04 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:04.446097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:04.446897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:04.454051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:04.454634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:04.455153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:04.456324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:04.456876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:04.457402 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:04.593516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:04.606178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3b37f3a2-c9e3-4dbf-8fd1-7286e8f66c02 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.164880 Aug 06 22:12:04.606735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 115/236] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:04 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:04.812919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:04.813528 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:04.819517 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:04.819994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:04.820494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:04.821178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:04.821789 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:04.822224 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:04.955436 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:04.962925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2c67f0a5-e6c3-4da3-ad41-40706ad19f1e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.153950 Aug 06 22:12:04.964249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 122/237] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:04 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:05.314146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:05.314744 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:05.321235 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:05.321707 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:05.322303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:05.323894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:05.324691 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:05.325193 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:05.468274 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:05.476616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0c529825-a827-4f36-ba74-96898e58381c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.166216 Aug 06 22:12:05.477182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 116/238] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:05 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:05.626950 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:05.627558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:05.633576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:05.634052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:05.634485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:05.635165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:05.635700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:05.636146 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:05.771160 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:05.784854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fa2b943f-b912-4e46-afda-d7c2d9f2e9fd tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.156123 Aug 06 22:12:05.785432 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 123/239] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:05 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:05.984552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:05.985085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:05.991297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:05.991778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:05.992204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:05.992907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:05.993362 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:05.993781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:06.118302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:06.126283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2342ac05-a08c-4c2f-8214-ac4a04b5cb9c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.145672 Aug 06 22:12:06.126841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 117/240] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:05 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:06.498654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:06.499403 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:06.505376 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:06.505849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:06.506273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:06.506945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:06.507384 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:06.507795 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:06.635978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:06.643939 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-89a78b9b-767b-4a25-9de0-c75c7838944c tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.149695 Aug 06 22:12:06.644522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 124/241] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:06 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:06.806855 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:06.807499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:06.814016 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:06.814496 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:06.815036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:06.815723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:06.816167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:06.816595 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:06.834849 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:06.944032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:06.951861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-986f001e-b91f-469f-843e-9c51eb6c3b74 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.148857 Aug 06 22:12:06.952436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 118/242] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:06 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:07.147018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:07.147547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:07.154099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:07.154570 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:07.154994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:07.155666 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:07.156113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:07.156552 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:07.283759 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:07.291099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6485bf5e-1301-4a57-8799-e2ee0527078c tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.147982 Aug 06 22:12:07.291691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 125/243] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:07 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:07.664614 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:07.665253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:07.671264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:07.671748 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:07.672177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:07.672888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:07.673338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:07.673783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:07.802899 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:07.811538 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f48bc318-c092-4598-acf6-349bab1760a7 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.150829 Aug 06 22:12:07.812128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 119/244] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:07 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:07.973923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:07.974517 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:07.981536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:07.982009 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:07.982431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:07.983143 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:07.983586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:07.984000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:08.118286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:08.126773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d03ae995-e6ec-4fb1-9f77-56ae83258740 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.157076 Aug 06 22:12:08.127571 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 126/245] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:07 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:08.311739 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:08.312254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:08.318711 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:08.319186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:08.319611 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:08.320279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:08.320749 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:08.321165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:08.449150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:08.456470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a7d0703e-cd03-430a-a957-75bb867e7900 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.148764 Aug 06 22:12:08.457029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 120/246] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:08 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:08.833380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:08.834046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:08.840811 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:08.841295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:08.841734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:08.842415 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:08.842862 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:08.843313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:08.974753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:08.983541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ca9635f0-bd2a-4e38-a9cc-1bc7ac8493d8 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.154063 Aug 06 22:12:08.984104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 127/247] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:08 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:09.148811 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:09.149416 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:09.156290 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:09.156798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:09.157260 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:09.157975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:09.158424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:09.158845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:09.478552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:09.478688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:09.478688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:09.483759 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5e3ba067-a908-4a5d-b486-f49440c4ecc7 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.338698 Aug 06 22:12:09.484332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 121/248] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:09 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:09.484502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:09.485186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:09.485604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:09.486294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:09.486763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:09.487174 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:09.505254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:09.617327 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:09.624563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-354f698d-3437-41b8-b62c-615cf5a3ecf4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.150921 Aug 06 22:12:09.625124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 128/249] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:09 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:10.005007 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:10.005673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:10.012390 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:10.012911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:10.013379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:10.014068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:10.014551 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:10.014975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:10.143930 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:10.151951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8d85944e-2eab-4e9e-b779-826f3e2dbf7f tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.150693 Aug 06 22:12:10.152611 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 122/250] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:10 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:10.504181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:10.504832 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:10.511655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:10.512365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:10.513029 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:10.513923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:10.514456 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:10.514895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:10.648900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:10.650255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:10.664247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:10.668705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:10.669986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:10.671114 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:10.672691 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:10.673888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:10.675130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:10.677557 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-58ccf246-ef71-40ea-86c1-7278a5d990a3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.177022 Aug 06 22:12:10.678732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 129/251] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:10 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:10.828943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:10.836501 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3caa0c4e-04b2-4f86-9179-4ef399dd602a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.194111 Aug 06 22:12:10.837057 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 123/252] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:10 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:11.173645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:11.174253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:11.181141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:11.186890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:11.186890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:11.186890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:11.186890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:11.187238 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:11.207263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-f22c7653-7adb-4935-8b7c-e819cc7eb83b req-a8bf2d45-00c6-4b82-9f16-2c38e1b7b07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391d123e-483c-4cf0-96e3-f80acc6140c1", "name": "network-vif-plugged", "status": "completed", "tag": "fa3ba80d-c57d-4032-8c76-232d92ebb02e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:11.236674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f22c7653-7adb-4935-8b7c-e819cc7eb83b req-a8bf2d45-00c6-4b82-9f16-2c38e1b7b07e service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:11.237640 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f22c7653-7adb-4935-8b7c-e819cc7eb83b req-a8bf2d45-00c6-4b82-9f16-2c38e1b7b07e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:11.238126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f22c7653-7adb-4935-8b7c-e819cc7eb83b req-a8bf2d45-00c6-4b82-9f16-2c38e1b7b07e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:11.255554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-f22c7653-7adb-4935-8b7c-e819cc7eb83b req-a8bf2d45-00c6-4b82-9f16-2c38e1b7b07e service nova] Creating event network-vif-plugged:fa3ba80d-c57d-4032-8c76-232d92ebb02e for instance 391d123e-483c-4cf0-96e3-f80acc6140c1 on hv-cinder-84984 Aug 06 22:12:11.263274 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-f22c7653-7adb-4935-8b7c-e819cc7eb83b req-a8bf2d45-00c6-4b82-9f16-2c38e1b7b07e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060818 Aug 06 22:12:11.264652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 124/253] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:11.378680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:11.392473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fd398d85-a04a-45ef-9548-4448577c581b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1552 microversion: 2.1 time: 0.222608 Aug 06 22:12:11.399392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 130/254] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:11 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:11.703251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-6519d65a-db4f-442b-b379-43b9e59497d7 req-44f6f6ca-4ea7-42f7-a130-4bff22bcdc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7471b413-f47d-4f7a-a2f8-1e4131d39531", "name": "network-vif-deleted", "tag": "04fbb9fe-cdaf-4773-ae55-3a9eb80e33a0"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:11.704193 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:11.704956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:11.713305 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:11.714200 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:11.715523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:11.717797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:11.718557 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:11.719149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:11.732643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6519d65a-db4f-442b-b379-43b9e59497d7 req-44f6f6ca-4ea7-42f7-a130-4bff22bcdc7c service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:11.732643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6519d65a-db4f-442b-b379-43b9e59497d7 req-44f6f6ca-4ea7-42f7-a130-4bff22bcdc7c service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:11.732643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6519d65a-db4f-442b-b379-43b9e59497d7 req-44f6f6ca-4ea7-42f7-a130-4bff22bcdc7c service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:11.753828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-6519d65a-db4f-442b-b379-43b9e59497d7 req-44f6f6ca-4ea7-42f7-a130-4bff22bcdc7c service nova] Creating event network-vif-deleted:04fbb9fe-cdaf-4773-ae55-3a9eb80e33a0 for instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 on hv-cinder-84984 Aug 06 22:12:11.761453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-6519d65a-db4f-442b-b379-43b9e59497d7 req-44f6f6ca-4ea7-42f7-a130-4bff22bcdc7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068943 Aug 06 22:12:11.762669 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 125/255] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:12:11.858524 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:11.861770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:11.865598 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:11.866076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:11.866505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:11.867188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:11.867633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:11.868048 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:11.876815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:11.884357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3872fe56-3b44-46b7-b7dc-f9d44d771e26 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.189219 Aug 06 22:12:11.884993 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 131/256] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:11 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:12.001793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:12.009380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6e34afb0-48b4-4ce0-9df1-6967e08ecd23 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.155588 Aug 06 22:12:12.009932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 126/257] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:11 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:12.417135 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:12.418150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:12.424239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:12.424763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:12.425196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:12.425887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:12.426378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:12.426804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:12.495430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:12.523634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7d943eec-0b05-446f-917f-008a48c6a92e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1344 microversion: 2.1 time: 0.110931 Aug 06 22:12:12.524188 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 132/258] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:12 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1344 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:12.906940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:12.907478 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:12.913825 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:12.914311 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:12.914822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:12.915571 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:12.916208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:12.917414 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:13.030553 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:13.031154 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:13.037126 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:13.037610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:13.038042 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:13.038729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:13.039179 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:13.042177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:13.045001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:13.052752 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0ddb6830-392e-4d25-a652-e75d93149a46 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.149865 Aug 06 22:12:13.053357 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 127/259] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:12 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:13.178184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:13.186272 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b0c0b624-125c-47de-9fe7-cbbbbb77041e tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1313 microversion: 2.1 time: 0.159607 Aug 06 22:12:13.186832 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 133/260] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:13 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:13.544912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:13.545513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:13.552643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:13.553125 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:13.553548 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:13.554233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:13.554679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:13.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:13.620926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:13.629302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-56b811f2-a091-4621-9225-0d5513be206b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1344 microversion: 2.1 time: 0.088943 Aug 06 22:12:13.629988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 128/261] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:13 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:13.790695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-f3a330a3-6959-40ff-be26-3689196247b3 req-6a9e3a80-4116-47c3-b388-465efeac1693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898f71d4-ea33-4d80-bad4-530206ed71d3", "tag": "1a3e64fb-c256-48a6-a0eb-0dfe19d53b3a"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:13.801155 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f3a330a3-6959-40ff-be26-3689196247b3 req-6a9e3a80-4116-47c3-b388-465efeac1693 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:13.801697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f3a330a3-6959-40ff-be26-3689196247b3 req-6a9e3a80-4116-47c3-b388-465efeac1693 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:13.802185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f3a330a3-6959-40ff-be26-3689196247b3 req-6a9e3a80-4116-47c3-b388-465efeac1693 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:13.813077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-f3a330a3-6959-40ff-be26-3689196247b3 req-6a9e3a80-4116-47c3-b388-465efeac1693 service nova] Creating event network-changed:1a3e64fb-c256-48a6-a0eb-0dfe19d53b3a for instance 898f71d4-ea33-4d80-bad4-530206ed71d3 on hv-cinder-84984 Aug 06 22:12:13.818532 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-f3a330a3-6959-40ff-be26-3689196247b3 req-6a9e3a80-4116-47c3-b388-465efeac1693 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031526 Aug 06 22:12:13.819087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 134/262] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:12:14.076354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:14.078156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:14.085754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:14.086240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:14.086673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:14.087422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:14.087883 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:14.089050 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:14.206904 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:14.207600 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:14.214594 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:14.215072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:14.215500 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:14.221976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:14.221976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:14.221976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:14.235813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:14.243619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fda5645e-3017-4727-a7dc-62d93c92d468 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.174023 Aug 06 22:12:14.244957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 129/263] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:14 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:14.348113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:14.356144 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-11ddccbe-b694-4ef6-ae8c-96a491ce4704 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1498 microversion: 2.1 time: 0.153397 Aug 06 22:12:14.356743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 135/264] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:14 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:14.649928 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:14.650692 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:14.656943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:14.657525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:14.657856 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:14.658544 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:14.658996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:14.659414 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:14.722631 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:14.731474 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0a708b90-e067-49a8-b803-ed6ca3c341f1 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1344 microversion: 2.1 time: 0.085671 Aug 06 22:12:14.732027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 130/265] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:14 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:15.265735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:15.266338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:15.272191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:15.272701 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:15.273129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:15.273809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:15.274259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:15.274669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:15.407459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:15.415040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8723d245-55f6-4586-a2c2-8af52349ce4a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.153109 Aug 06 22:12:15.415620 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 136/266] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:15 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:15.752834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:15.753685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:15.764051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:15.764051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:15.764541 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:15.765112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:15.765552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:15.766452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:15.766915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:15.767421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:15.770105 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:15.770702 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:15.771179 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:15.771903 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:15.772423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:15.773184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:15.803034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:12:15.837120 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:15.847261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e5c6efb6-be17-4e08-87ca-356486ed545b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1344 microversion: 2.1 time: 0.098167 Aug 06 22:12:15.847803 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 131/267] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:15 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:16.229013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9c6331bb-5d85-4064-a7aa-e91ea099bff4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "DELETE /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 204 len: 0 microversion: 2.1 time: 0.470671 Aug 06 22:12:16.233101 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 137/268] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:12:15 2022] DELETE /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:12:16.237874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:16.238642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:16.246925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:16.246925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:16.246925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:16.246925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:16.247272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:16.257517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:16.411317 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:16.419591 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0b108c52-b9fb-4d61-ac80-4ba61bfdd9ae tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1504 microversion: 2.1 time: 0.185449 Aug 06 22:12:16.420494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 132/269] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:16 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:16.437810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:16.437810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:16.444142 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:16.444668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:16.445103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:16.445786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:16.446234 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:16.446653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:16.583057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:16.590613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4eb1c47f-abca-44af-86ba-db0b5d427274 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.157762 Aug 06 22:12:16.591174 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 138/270] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:16 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:16.870676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:16.871321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:16.879250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:16.879824 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:16.880335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:16.881115 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:16.881651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:16.882136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:16.953050 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:16.959338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-02a4b823-db1c-41f2-949e-8acd434a5647 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1344 microversion: 2.1 time: 0.094213 Aug 06 22:12:16.960060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 133/271] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:16 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:17.444956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:17.445593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:17.451584 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:17.452056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:17.452519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:17.453195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:17.453636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:17.454051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:17.585634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:17.593819 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-487c79c4-906d-4ba1-9fba-eb4a0267cc80 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1504 microversion: 2.1 time: 0.152776 Aug 06 22:12:17.594472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 139/272] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:17 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:17.619345 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:17.619952 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:17.626664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:17.627245 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:17.627740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:17.628382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:17.628825 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:17.629249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:17.770723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:17.778851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4e0d7bab-83ae-4da1-a368-cd406ddf9840 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.163413 Aug 06 22:12:17.779468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 134/273] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:17 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:17.981452 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:17.982007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:17.987894 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:17.988370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:17.988834 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:17.989542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:17.989994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:17.990413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:18.020342 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:18.020857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:18.021273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:18.021741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lazy-loading 'fault' on Instance uuid 7471b413-f47d-4f7a-a2f8-1e4131d39531 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:12:18.067495 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:18.075603 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-12e10eb5-2fae-4a3a-86e7-5f2f2a35c04b tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1349 microversion: 2.1 time: 0.098589 Aug 06 22:12:18.088860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 140/274] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:17 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:18.615735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:18.617056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:18.625875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:18.625875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:18.625875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:18.625875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:18.626461 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:18.626461 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:18.809735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:18.810378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:18.817347 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:18.819948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:18.820460 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:18.820889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:18.821587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:18.822034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:18.823153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:18.827204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a7f72328-d577-4cb1-bf8b-8ae24d5b0ece tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1504 microversion: 2.1 time: 0.215255 Aug 06 22:12:18.828012 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 135/275] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:18 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:18.966353 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:18.973954 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4ea50f56-9cc5-4484-8397-0a88eaac6da4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.169774 Aug 06 22:12:18.974513 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 141/276] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:18 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:19.099183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:19.099821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:19.108102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:19.108102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:19.108811 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:19.109652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:19.110101 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:19.110679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:19.135107 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:19.148770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:19.149247 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:19.149675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:19.150127 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lazy-loading 'fault' on Instance uuid 7471b413-f47d-4f7a-a2f8-1e4131d39531 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:12:19.201299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:19.209372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e5ee66b3-5ac2-40e2-96e0-5b7829236a31 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1349 microversion: 2.1 time: 0.114130 Aug 06 22:12:19.209940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 136/277] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:19 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1349 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:19.424265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-40ffc9ce-1a1c-4f2a-a607-185f0b65ddd3 req-6c9186b2-7486-403a-8fa9-88938012cfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898f71d4-ea33-4d80-bad4-530206ed71d3", "name": "network-vif-plugged", "status": "completed", "tag": "1a3e64fb-c256-48a6-a0eb-0dfe19d53b3a"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:19.437264 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-40ffc9ce-1a1c-4f2a-a607-185f0b65ddd3 req-6c9186b2-7486-403a-8fa9-88938012cfba service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:19.437848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-40ffc9ce-1a1c-4f2a-a607-185f0b65ddd3 req-6c9186b2-7486-403a-8fa9-88938012cfba service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:19.438454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-40ffc9ce-1a1c-4f2a-a607-185f0b65ddd3 req-6c9186b2-7486-403a-8fa9-88938012cfba service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:19.452295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-40ffc9ce-1a1c-4f2a-a607-185f0b65ddd3 req-6c9186b2-7486-403a-8fa9-88938012cfba service nova] Creating event network-vif-plugged:1a3e64fb-c256-48a6-a0eb-0dfe19d53b3a for instance 898f71d4-ea33-4d80-bad4-530206ed71d3 on hv-cinder-84984 Aug 06 22:12:19.457685 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-40ffc9ce-1a1c-4f2a-a607-185f0b65ddd3 req-6c9186b2-7486-403a-8fa9-88938012cfba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039128 Aug 06 22:12:19.458597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 142/278] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:19.848141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:19.848778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:19.857158 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:19.858555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:19.859190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:19.860254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:19.861005 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:19.861616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:19.996423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:19.997766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:20.012119 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:20.015275 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:20.016941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:20.021331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:20.021331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:20.021331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:20.218828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:20.227479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-56240fa0-8cce-4bef-b068-e7f626cfdb29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1504 microversion: 2.1 time: 0.383034 Aug 06 22:12:20.232733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 137/279] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:19 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:20.250995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:20.258170 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:20.272520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:20.275845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:20.278296 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:20.282833 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:20.282833 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:20.282833 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:20.345640 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:20.355301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e6cfe12a-1051-4762-bea2-447cde1e1952 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.363646 Aug 06 22:12:20.360861 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 143/280] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:19 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:20.378067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:20.378556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:20.378985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:20.379439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lazy-loading 'fault' on Instance uuid 7471b413-f47d-4f7a-a2f8-1e4131d39531 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:12:20.450921 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f161eb377e4f809b2232c1047c0bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1386a21549b4faf87836a9be75c670c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:20.461878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-388489f7-b4b3-4855-868e-9d2e8dd33651 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 200 len: 1349 microversion: 2.1 time: 0.226752 Aug 06 22:12:20.462710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 138/281] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:20 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 1349 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:20.994875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-def7742e-b9af-43bc-9b4d-081555b7db17 req-d4f1268b-3dc6-4995-8e76-099b91461fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391d123e-483c-4cf0-96e3-f80acc6140c1", "name": "network-vif-deleted", "tag": "fa3ba80d-c57d-4032-8c76-232d92ebb02e"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:21.004046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-def7742e-b9af-43bc-9b4d-081555b7db17 req-d4f1268b-3dc6-4995-8e76-099b91461fbe service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.004673 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-def7742e-b9af-43bc-9b4d-081555b7db17 req-d4f1268b-3dc6-4995-8e76-099b91461fbe service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.004973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-def7742e-b9af-43bc-9b4d-081555b7db17 req-d4f1268b-3dc6-4995-8e76-099b91461fbe service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.015912 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-def7742e-b9af-43bc-9b4d-081555b7db17 req-d4f1268b-3dc6-4995-8e76-099b91461fbe service nova] Creating event network-vif-deleted:fa3ba80d-c57d-4032-8c76-232d92ebb02e for instance 391d123e-483c-4cf0-96e3-f80acc6140c1 on hv-cinder-84984 Aug 06 22:12:21.020793 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-def7742e-b9af-43bc-9b4d-081555b7db17 req-d4f1268b-3dc6-4995-8e76-099b91461fbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029852 Aug 06 22:12:21.021357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 144/282] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:21.249189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:21.250003 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:21.274233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.275875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.276612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.277670 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.278336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.278931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.381364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:21.382421 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:21.397052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.397052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.397547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.398430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.399059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.399817 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.405876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:21.763486 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:21.772562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-32fa7f85-66fb-40c1-8991-43ab6fff1574 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1298 microversion: 2.1 time: 0.527339 Aug 06 22:12:21.786924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 139/283] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:21 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1298 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:21.786924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:21.786924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:21.794575 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.795116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.795566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.796284 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.796829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.797447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.818483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] HTTP exception thrown: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Request method failure captured: Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 HTTP/1.1 Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubZyRzqyAQuPHcZrau66PkhoMzJFtE3bJSXnJHfX_0sW-Z8gN_bCInRqm9pxqmbz2dRzOyvNunH0jkXpa0Bp7vluFrawY1ENoTK0L8Pn32ZY1b7zOM_hlER93QuxAk8VHcANLJkhfFM5_M1RN7EDgBtfDCkjrSFzmpacTqCb1o6oto Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: b1386a21549b4faf87836a9be75c670c Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:12:21.823802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1386a21549b4faf87836a9be75c670c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: b1386a21549b4faf87836a9be75c670c Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-DeleteServersTestJSON-957660004-project Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 13f161eb377e4f809b2232c1047c0bb5 Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-DeleteServersTestJSON-957660004-project Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:21.825760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '7471b413-f47d-4f7a-a2f8-1e4131d39531'} Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:12:21.832581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:21.834073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:21.835273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Returning 404 to user: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:12:21.835273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-06108709-add4-44c6-a238-f3db3911239a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 404 len: 111 microversion: 2.1 time: 0.046258 Aug 06 22:12:21.835273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 140/284] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:21 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:12:21.919645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:21.937087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cfa56bb5-3a73-40e4-bf00-98883a0528bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1318 microversion: 2.1 time: 0.551921 Aug 06 22:12:21.939182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 145/285] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:21 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:21.964623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:21.966974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:21.976348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.976879 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.977385 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.978081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:21.978578 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:21.979076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:21.994979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] HTTP exception thrown: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Request method failure captured: Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531/os-volume_attachments HTTP/1.1 Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubZyRzqyAQuPHcZrau66PkhoMzJFtE3bJSXnJHfX_0sW-Z8gN_bCInRqm9pxqmbz2dRzOyvNunH0jkXpa0Bp7vluFrawY1ENoTK0L8Pn32ZY1b7zOM_hlER93QuxAk8VHcANLJkhfFM5_M1RN7EDgBtfDCkjrSFzmpacTqCb1o6oto Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: b1386a21549b4faf87836a9be75c670c Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:12:21.997310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1386a21549b4faf87836a9be75c670c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: b1386a21549b4faf87836a9be75c670c Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-DeleteServersTestJSON-957660004-project Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 13f161eb377e4f809b2232c1047c0bb5 Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-DeleteServersTestJSON-957660004-project Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:21.998721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'server_id': '7471b413-f47d-4f7a-a2f8-1e4131d39531'} Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:12:21.999533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:22.000868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:22.002138 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Returning 404 to user: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:12:22.002138 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3f7ee6e4-7542-48e0-ad19-6d6f1698b2d2 tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038541 Aug 06 22:12:22.002138 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 141/286] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:12:21 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:12:22.795724 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:22.797950 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:22.805876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:22.806634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:22.807861 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:22.808747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:22.809195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:22.809674 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:22.841994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:22.842653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:22.843239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:22.843677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lazy-loading 'fault' on Instance uuid 391d123e-483c-4cf0-96e3-f80acc6140c1 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:12:22.890043 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:22.897522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-adfcc81c-cc3f-4b27-bda2-a2a4b5effee1 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 200 len: 1303 microversion: 2.1 time: 0.108052 Aug 06 22:12:22.898076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 146/287] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:22 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:22.962027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:22.962792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:22.970856 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:22.971973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:22.972436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:22.973140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:22.973587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:22.974206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:23.194605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:23.203957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e41db9e1-74c5-4071-9c30-0e71dd3f0076 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1506 microversion: 2.1 time: 0.245744 Aug 06 22:12:23.204802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 142/288] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:22 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:23.434185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:23.435271 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:23.455824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:23.455824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:23.455824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:23.455824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:23.456577 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:23.456577 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:23.470501 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] HTTP exception thrown: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Request method failure captured: Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 HTTP/1.1 Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubZyRzqyAQuPHcZrau66PkhoMzJFtE3bJSXnJHfX_0sW-Z8gN_bCInRqm9pxqmbz2dRzOyvNunH0jkXpa0Bp7vluFrawY1ENoTK0L8Pn32ZY1b7zOM_hlER93QuxAk8VHcANLJkhfFM5_M1RN7EDgBtfDCkjrSFzmpacTqCb1o6oto Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: b1386a21549b4faf87836a9be75c670c Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:12:23.476621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1386a21549b4faf87836a9be75c670c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: b1386a21549b4faf87836a9be75c670c Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-DeleteServersTestJSON-957660004-project Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 13f161eb377e4f809b2232c1047c0bb5 Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-DeleteServersTestJSON-957660004-project Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.477852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '7471b413-f47d-4f7a-a2f8-1e4131d39531'} Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:12:23.478680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.479827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.482107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Returning 404 to user: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:12:23.483183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fc5baf6d-cbf5-45d5-b804-43be0becda4a tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 404 len: 111 microversion: 2.1 time: 0.054282 Aug 06 22:12:23.483901 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 147/289] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:12:23 2022] DELETE /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:12:23.491925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:23.492573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] [instance: 7471b413-f47d-4f7a-a2f8-1e4131d39531] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:23.503262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:23.503764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:23.504242 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:23.504972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:23.505425 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:23.505845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:23.533967 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] HTTP exception thrown: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Request method failure captured: Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 HTTP/1.1 Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubZyRzqyAQuPHcZrau66PkhoMzJFtE3bJSXnJHfX_0sW-Z8gN_bCInRqm9pxqmbz2dRzOyvNunH0jkXpa0Bp7vluFrawY1ENoTK0L8Pn32ZY1b7zOM_hlER93QuxAk8VHcANLJkhfFM5_M1RN7EDgBtfDCkjrSFzmpacTqCb1o6oto Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: b1386a21549b4faf87836a9be75c670c Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:12:23.535493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1386a21549b4faf87836a9be75c670c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1386a21549b4faf87836a9be75c670c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: b1386a21549b4faf87836a9be75c670c Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-DeleteServersTestJSON-957660004 Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-DeleteServersTestJSON-957660004-project Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 13f161eb377e4f809b2232c1047c0bb5 Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-DeleteServersTestJSON-957660004-project Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.537052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '7471b413-f47d-4f7a-a2f8-1e4131d39531'} Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:12:23.537709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. Aug 06 22:12:23.538734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.539949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] Returning 404 to user: Instance 7471b413-f47d-4f7a-a2f8-1e4131d39531 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:12:23.547035 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8caf4df0-d2af-4a37-807b-72a4c8d2551e tempest-DeleteServersTestJSON-957660004 tempest-DeleteServersTestJSON-957660004-project] 10.222.0.18 "GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531" status: 404 len: 111 microversion: 2.1 time: 0.059094 Aug 06 22:12:23.547632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 143/290] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:23 2022] GET /compute/v2.1/servers/7471b413-f47d-4f7a-a2f8-1e4131d39531 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:12:23.932803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:23.934137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 391d123e-483c-4cf0-96e3-f80acc6140c1] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:23.941624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:23.942365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:23.942797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:23.943648 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:23.944279 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:23.945210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:23.967584 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] HTTP exception thrown: Instance 391d123e-483c-4cf0-96e3-f80acc6140c1 could not be found. Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Request method failure captured: Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 HTTP/1.1 Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ucbjnUGbCQN92ZL5pJI-DsVp0FsYuspeC8VzBHFJmMpWjgeo8Qt3u43ajzgz8q1zk1SJhzBoE4qAQhKi7Lk-IL4Oi3SsyrBMXOLc-3-dKkEj5rHu-GtKxvicSuKmH5H8Zr3AdHiQu6Y0mLOxSbFfdA7z1vEjDtkhofR8563OE039CI Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 6cc6b84f1fcc4e28b7c3a7547b6640b8 Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesActionsTest-937455463 Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:12:23.969209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6cc6b84f1fcc4e28b7c3a7547b6640b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6cc6b84f1fcc4e28b7c3a7547b6640b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6cc6b84f1fcc4e28b7c3a7547b6640b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6cc6b84f1fcc4e28b7c3a7547b6640b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesActionsTest-937455463 Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 6cc6b84f1fcc4e28b7c3a7547b6640b8 Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesActionsTest-937455463 Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesActionsTest-937455463-project Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 26b6e4a0640548dd8d6bb800d1f26b95 Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesActionsTest-937455463-project Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 391d123e-483c-4cf0-96e3-f80acc6140c1 could not be found. Aug 06 22:12:23.970468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '391d123e-483c-4cf0-96e3-f80acc6140c1'} Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391d123e-483c-4cf0-96e3-f80acc6140c1 could not be found. Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:12:23.971292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391d123e-483c-4cf0-96e3-f80acc6140c1 could not be found. Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391d123e-483c-4cf0-96e3-f80acc6140c1 could not be found. Aug 06 22:12:23.972735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:12:23.974281 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Returning 404 to user: Instance 391d123e-483c-4cf0-96e3-f80acc6140c1 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:12:23.974281 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6d17293c-531d-4d4c-ab75-46d971925748 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1" status: 404 len: 111 microversion: 2.1 time: 0.056035 Aug 06 22:12:23.984712 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 148/291] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:23 2022] GET /compute/v2.1/servers/391d123e-483c-4cf0-96e3-f80acc6140c1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:12:24.129449 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-255547103", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "networks": [{"uuid": "aa8633b3-8e9c-4003-b8c9-09a0704a5ffb"}]}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:24.237104 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] validate_networks() for [('aa8633b3-8e9c-4003-b8c9-09a0704a5ffb', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:12:25.017740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:12:25.018280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:12:25.018896 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:12:25.019369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:12:25.019862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:12:25.055731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:25.055731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:25.055731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:25.055731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:25.057737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:25.060120 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:25.132635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Getting quotas for project 6cc6b84f1fcc4e28b7c3a7547b6640b8. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:12:25.153797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Getting quotas for user 26b6e4a0640548dd8d6bb800d1f26b95 and project 6cc6b84f1fcc4e28b7c3a7547b6640b8. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:12:25.218996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:12:25.229257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:12:25.436773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e96eebea-38c9-48ca-a096-37901da536b8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311734 Aug 06 22:12:25.444058 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 144/292] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:12:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 22:12:25.451061 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-06c6bd8d-9de3-472d-b9f5-f37a8ba003c9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:25.451677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-06c6bd8d-9de3-472d-b9f5-f37a8ba003c9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:25.563187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-06c6bd8d-9de3-472d-b9f5-f37a8ba003c9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:25.594066 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-06c6bd8d-9de3-472d-b9f5-f37a8ba003c9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1213 microversion: 2.1 time: 0.149325 Aug 06 22:12:25.600937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 149/293] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:25 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:26.621835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d037a512-4d4b-407e-87a0-ef742b07a5db tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:26.628040 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d037a512-4d4b-407e-87a0-ef742b07a5db tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:26.855545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d037a512-4d4b-407e-87a0-ef742b07a5db tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:26.866651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d037a512-4d4b-407e-87a0-ef742b07a5db tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1213 microversion: 2.1 time: 0.250780 Aug 06 22:12:26.881633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 145/294] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:26 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1213 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:27.891597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:27.892448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:27.907747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:27.911613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:27.911613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:27.912016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:27.912531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:27.912954 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:28.033472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:28.052649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-34abd2a9-e7db-45e7-9d21-af46c4699ff7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1265 microversion: 2.1 time: 0.168566 Aug 06 22:12:28.068734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 150/295] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:27 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:29.081584 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:29.088104 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:29.114336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:29.117361 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:29.118164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:29.120676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:29.123786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:29.124430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:29.295494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:29.306934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-43a19fb4-32bb-48c9-9f73-b8dfe6f38f6f tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1283 microversion: 2.1 time: 0.233768 Aug 06 22:12:29.335450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 146/296] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:29 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1283 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:30.335201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:30.335879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:30.343212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:30.344933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:30.347494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:30.348772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:30.349609 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:30.350272 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:30.547286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:30.557767 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ad6e7554-d337-49d6-b9d7-954a689374d6 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1271 microversion: 2.1 time: 0.223490 Aug 06 22:12:30.568875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 151/297] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:30 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:31.592064 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:31.592064 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:31.605873 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:31.607699 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:31.612306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:31.616381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:31.619455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:31.625107 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:31.916993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:31.928766 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c2b92c71-0392-4f50-ad5e-a721532f96f9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.353660 Aug 06 22:12:31.929343 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 147/298] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:31 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:32.472874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-fb8b51cf-02ef-4e82-89b8-de69e0a72c18 req-090fed31-2ce0-4d25-8e5a-8410eeb52b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48146962-975b-459d-b6c6-a228551ad99b", "tag": "dee97aa5-10f3-402e-a373-8043113fd57b"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:32.490908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-fb8b51cf-02ef-4e82-89b8-de69e0a72c18 req-090fed31-2ce0-4d25-8e5a-8410eeb52b94 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:32.492796 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-fb8b51cf-02ef-4e82-89b8-de69e0a72c18 req-090fed31-2ce0-4d25-8e5a-8410eeb52b94 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:32.495272 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-fb8b51cf-02ef-4e82-89b8-de69e0a72c18 req-090fed31-2ce0-4d25-8e5a-8410eeb52b94 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:32.519683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-fb8b51cf-02ef-4e82-89b8-de69e0a72c18 req-090fed31-2ce0-4d25-8e5a-8410eeb52b94 service nova] Creating event network-changed:dee97aa5-10f3-402e-a373-8043113fd57b for instance 48146962-975b-459d-b6c6-a228551ad99b on hv-cinder-84984 Aug 06 22:12:32.525587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-fb8b51cf-02ef-4e82-89b8-de69e0a72c18 req-090fed31-2ce0-4d25-8e5a-8410eeb52b94 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057454 Aug 06 22:12:32.526597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 152/299] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:32.951009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:32.952270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:32.965170 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:32.965884 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:32.966482 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:32.968002 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:32.968665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:32.969438 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:33.254819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:33.263961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ad453e85-e8e6-4ba4-a952-ed62637a9868 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.318248 Aug 06 22:12:33.265024 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 148/300] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:32 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:34.285138 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:34.285825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:34.287762 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:34.293374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:34.293887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:34.294309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:34.294992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:34.295437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:34.295851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:34.591407 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:34.600168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-35701925-8fa8-4f0d-8792-5e0f5caa5ffb tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.319031 Aug 06 22:12:34.615546 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 153/301] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:34 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:35.438649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:35.631254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:35.631879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:35.671284 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:35.680879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:35.686704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:35.686704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:35.686704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:35.686704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:35.687221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:35.702426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e0144ea4-2bfa-4ca5-b5f8-ac32131bd68c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Action: 'create', calling method: .version_select at 0x7f30c6df8310>, body: {"keypair": {"name": "tempest-TestShelveInstance-355030664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrt8GRICWaV6+tD8nyYvhu7GzuIXQgjo5D9AZzbpPlfXtlRLkjYOn3CUKghDlWViuU2Lq+DnNms4kpec0/oYkN0fpf/Csb2v/6ob1Uw1PXxzhJeocKLayFqnBBs1K5D1g=="}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:35.727432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:35.751938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-e0144ea4-2bfa-4ca5-b5f8-ac32131bd68c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Getting quotas for project 6354597f8edf4ebc9539a33314e6bc06. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:12:35.762374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-e0144ea4-2bfa-4ca5-b5f8-ac32131bd68c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Getting quotas for user 9469cd012c2549288ba403902b667295 and project 6354597f8edf4ebc9539a33314e6bc06. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:12:35.865530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:35.874577 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f468a1ed-1f27-4923-b09c-482994fb2b29 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.256824 Aug 06 22:12:35.875189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 154/302] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:35 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:35.909441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e0144ea4-2bfa-4ca5-b5f8-ac32131bd68c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.470908 Aug 06 22:12:35.909441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 149/303] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:12:35 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:36.895083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:36.895688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:36.903542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:36.904018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:36.904665 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:36.905350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:36.905797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:36.906209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:37.056343 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:37.068244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e2574164-c084-4745-973a-c2be9c1b61a9 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.176818 Aug 06 22:12:37.082613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 155/304] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:36 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:38.093685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:38.094593 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:38.110926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:38.114154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:38.115235 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:38.117688 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:38.120456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:38.122133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:38.383053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:38.406372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e1f27ec2-df3c-4e36-9d45-29584c5b4a2d tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.317717 Aug 06 22:12:38.408667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 150/305] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:38 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:39.427896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:39.428546 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:39.436859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:39.437619 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:39.438837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:39.439798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:39.440711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:39.441318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:39.695632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:39.708485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c4bb9e28-f1a8-459c-b9b4-e16aa1058bf8 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.282959 Aug 06 22:12:39.708485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 156/306] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:39 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:40.240690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-ecf64ea3-d2b3-43e7-abf3-ee900c90db29 req-a0f6b835-6558-46fe-9c63-66169b9d4e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48146962-975b-459d-b6c6-a228551ad99b", "name": "network-vif-plugged", "status": "completed", "tag": "dee97aa5-10f3-402e-a373-8043113fd57b"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:40.265032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ecf64ea3-d2b3-43e7-abf3-ee900c90db29 req-a0f6b835-6558-46fe-9c63-66169b9d4e31 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:40.265818 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ecf64ea3-d2b3-43e7-abf3-ee900c90db29 req-a0f6b835-6558-46fe-9c63-66169b9d4e31 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:40.266450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ecf64ea3-d2b3-43e7-abf3-ee900c90db29 req-a0f6b835-6558-46fe-9c63-66169b9d4e31 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:40.290213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-ecf64ea3-d2b3-43e7-abf3-ee900c90db29 req-a0f6b835-6558-46fe-9c63-66169b9d4e31 service nova] Creating event network-vif-plugged:dee97aa5-10f3-402e-a373-8043113fd57b for instance 48146962-975b-459d-b6c6-a228551ad99b on hv-cinder-84984 Aug 06 22:12:40.311619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-ecf64ea3-d2b3-43e7-abf3-ee900c90db29 req-a0f6b835-6558-46fe-9c63-66169b9d4e31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077538 Aug 06 22:12:40.312332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 151/307] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:40.729862 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:40.730403 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:40.737677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:40.738153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:40.738596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:40.739352 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:40.739810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:40.740258 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:40.892895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:40.902177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b1fe12eb-c356-43b8-861a-302ec6817586 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.176534 Aug 06 22:12:40.904881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 157/308] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:40 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:41.569819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-285158897", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:41.636569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] validate_networks() for [('dc9946af-58f0-44bb-950a-34c53ff0c790', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:12:41.925487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:41.926775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:41.934064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:41.938536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:41.939041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:41.939797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:41.940264 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:41.940729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:42.330563 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:12:42.331240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:12:42.331928 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:12:42.332934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:12:42.332934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:12:42.344080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:42.344592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:42.345052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:42.345762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:42.346208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:42.346624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:42.365365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Getting quotas for project 480896a54dab43c8980c8b05c9a793e7. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:12:42.372161 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Getting quotas for user 700f40b4567a4bcdbb2194861f4497d5 and project 480896a54dab43c8980c8b05c9a793e7. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:12:42.375451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:42.384600 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ca54071d-dc36-46b6-b913-8338d84bbcc7 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1313 microversion: 2.1 time: 0.463820 Aug 06 22:12:42.385272 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 158/309] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:41 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:42.388232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:12:42.390686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:12:42.574346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-464595cc-e9eb-4b95-a722-d5715d7f677a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.106634 Aug 06 22:12:42.575373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 152/310] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:12:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:12:42.586815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-28963b1a-e852-4d3c-9327-63e5f41ff005 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:42.587701 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-28963b1a-e852-4d3c-9327-63e5f41ff005 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:42.663350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-28963b1a-e852-4d3c-9327-63e5f41ff005 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:42.669988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-28963b1a-e852-4d3c-9327-63e5f41ff005 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1221 microversion: 2.1 time: 0.087722 Aug 06 22:12:42.670756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 159/311] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:42 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:42.737436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-254265654", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:42.829306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] validate_networks() for [('dc9946af-58f0-44bb-950a-34c53ff0c790', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:12:43.269318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:12:43.269967 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:12:43.270432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:12:43.270997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:12:43.271409 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:12:43.297311 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:43.297792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:43.298216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:43.299988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:43.299988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:43.299988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:43.323322 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Getting quotas for project 480896a54dab43c8980c8b05c9a793e7. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:12:43.327493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Getting quotas for user 700f40b4567a4bcdbb2194861f4497d5 and project 480896a54dab43c8980c8b05c9a793e7. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:12:43.341955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:12:43.344193 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:12:43.404366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:43.405001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:43.418065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:43.418741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:43.419371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:43.420076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:43.422951 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:43.423416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:43.545321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9aebae1a-c755-42be-9f34-2c206c55fe53 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.810343 Aug 06 22:12:43.557117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 153/312] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:12:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:12:43.585142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0bec7f6e-fc62-414b-9409-e11405d65de3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:43.586054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0bec7f6e-fc62-414b-9409-e11405d65de3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:43.685888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0bec7f6e-fc62-414b-9409-e11405d65de3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:43.697083 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0bec7f6e-fc62-414b-9409-e11405d65de3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1221 microversion: 2.1 time: 0.129349 Aug 06 22:12:43.698094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 154/313] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:43 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:43.710134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:43.719648 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9facd93c-1775-4fe8-b7e8-2ed1779b83e4 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1497 microversion: 2.1 time: 0.318967 Aug 06 22:12:43.720478 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 160/314] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:43 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1497 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:44.719150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-17d42163-7d3b-4cca-85ed-b4a2f7449ad6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:44.720099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-17d42163-7d3b-4cca-85ed-b4a2f7449ad6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:44.798539 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-17d42163-7d3b-4cca-85ed-b4a2f7449ad6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:44.806091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-17d42163-7d3b-4cca-85ed-b4a2f7449ad6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1221 microversion: 2.1 time: 0.091524 Aug 06 22:12:44.806669 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 155/315] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:44 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:45.166776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:45.177051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:45.183698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:45.184385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:45.185107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:45.185955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:45.187222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:45.188131 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:45.220274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:12:45.681630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fad24204-7297-4603-8d59-869f4734c4c3 tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "DELETE /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 204 len: 0 microversion: 2.1 time: 0.517587 Aug 06 22:12:45.682924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 161/316] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:12:45 2022] DELETE /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:12:45.691697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:45.692314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:45.707187 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:45.715393 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:45.717179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:45.718100 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:45.719908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:45.720541 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:45.832465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:45.835545 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:45.847804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:45.850897 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:45.851563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:45.853076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:45.857468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:45.859720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:45.915197 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:45.927089 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f4f31449-6819-4183-bfa3-e18303f68a4a tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1503 microversion: 2.1 time: 0.239732 Aug 06 22:12:45.945057 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 156/317] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:45 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:45.987686 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:45.996785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-de3b2ecb-beec-4152-a040-a514f7cb0527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1217 microversion: 2.1 time: 0.171863 Aug 06 22:12:45.997688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 162/318] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:45 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:46.952536 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:46.953564 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:46.960230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:46.960762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:46.961389 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:46.963017 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:46.963477 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:46.963906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:47.030899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:47.033077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:47.043181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:47.043679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:47.044172 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:47.045345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:47.046525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:47.047162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:47.171669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:47.177464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:47.189414 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-24cf674b-7be7-440d-9055-3db2c413fe34 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1273 microversion: 2.1 time: 0.165009 Aug 06 22:12:47.193255 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 163/319] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:47 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:47.238214 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:47.252623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6c6231b7-e87d-4add-84b3-e16816d307df tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1503 microversion: 2.1 time: 0.304557 Aug 06 22:12:47.262179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 157/320] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:46 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1503 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:48.197432 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4d17749-87ac-487e-a9f1-52147608e29d", "device": "/dev/sdb"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:48.203841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:48.219227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:48.221784 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:48.222556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:48.223203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:48.223948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:48.230214 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:48.230214 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:48.230214 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:48.234465 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:48.235177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:48.235819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:48.236839 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:48.237480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:48.238149 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:48.375840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:48.403166 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9cca2e40-fdc3-40b4-9761-87a6cdd6e41f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1273 microversion: 2.1 time: 0.189631 Aug 06 22:12:48.404161 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 158/321] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:48 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:48.410641 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:48.412528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:48.422042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:48.423886 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:48.423886 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:48.423886 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:48.426682 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:48.433355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:48.608859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:48.625266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-13e47bfe-c188-4330-9341-9a03f4d92aab tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1503 microversion: 2.1 time: 0.219293 Aug 06 22:12:48.639868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 159/322] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:48 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:48.748828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-300f3102-1d6f-4e2d-a409-65192c3fe7eb req-5017c6d4-ce46-4582-a18e-9062692ba64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48146962-975b-459d-b6c6-a228551ad99b", "name": "network-vif-deleted", "tag": "dee97aa5-10f3-402e-a373-8043113fd57b"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:48.758970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-300f3102-1d6f-4e2d-a409-65192c3fe7eb req-5017c6d4-ce46-4582-a18e-9062692ba64e service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:48.759444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-300f3102-1d6f-4e2d-a409-65192c3fe7eb req-5017c6d4-ce46-4582-a18e-9062692ba64e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:48.759873 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-300f3102-1d6f-4e2d-a409-65192c3fe7eb req-5017c6d4-ce46-4582-a18e-9062692ba64e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:48.779480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-300f3102-1d6f-4e2d-a409-65192c3fe7eb req-5017c6d4-ce46-4582-a18e-9062692ba64e service nova] Creating event network-vif-deleted:dee97aa5-10f3-402e-a373-8043113fd57b for instance 48146962-975b-459d-b6c6-a228551ad99b on hv-cinder-84984 Aug 06 22:12:48.787556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-300f3102-1d6f-4e2d-a409-65192c3fe7eb req-5017c6d4-ce46-4582-a18e-9062692ba64e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042474 Aug 06 22:12:48.788494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 160/323] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:12:49.427660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:49.428467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:49.435638 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:49.436168 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:49.436912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:49.437624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:49.438074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:49.438658 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:49.504085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:49.507604 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:49.512154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d0608c95-7055-4884-832f-5f67b16033a2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1279 microversion: 2.1 time: 0.089158 Aug 06 22:12:49.512757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 161/324] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:49 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:49.646894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:49.647533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:49.661183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:49.661183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:49.661183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:49.661183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:49.661525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:49.661525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:49.687380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:49.688009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:49.688446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:49.688902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lazy-loading 'fault' on Instance uuid 48146962-975b-459d-b6c6-a228551ad99b {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:12:49.736687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b6e4a0640548dd8d6bb800d1f26b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc6b84f1fcc4e28b7c3a7547b6640b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:49.746581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-30a1d5ac-fb30-4166-95f9-8f603157e4c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "POST /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.557481 Aug 06 22:12:49.747830 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-361a934d-079a-4e75-bc3f-b40915ca45ff tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 200 len: 1303 microversion: 2.1 time: 0.104739 Aug 06 22:12:49.759784 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 162/325] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:49 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:12:49.769365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 164/326] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:12:48 2022] POST /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3/os-volume_attachments => generated 194 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:49.940751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-05bd609b-e98b-496b-847d-5a3b434afcd9 req-8bce7a38-b993-44f5-80e3-024ae7d8fa67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fe6d06-81d1-46d4-a10a-54fc6d97cea9", "tag": "af724266-6923-4b34-aa57-73b075c36dc5"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:49.951469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-05bd609b-e98b-496b-847d-5a3b434afcd9 req-8bce7a38-b993-44f5-80e3-024ae7d8fa67 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:49.952275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-05bd609b-e98b-496b-847d-5a3b434afcd9 req-8bce7a38-b993-44f5-80e3-024ae7d8fa67 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:49.952911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-05bd609b-e98b-496b-847d-5a3b434afcd9 req-8bce7a38-b993-44f5-80e3-024ae7d8fa67 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:49.965526 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-05bd609b-e98b-496b-847d-5a3b434afcd9 req-8bce7a38-b993-44f5-80e3-024ae7d8fa67 service nova] Creating event network-changed:af724266-6923-4b34-aa57-73b075c36dc5 for instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 on hv-cinder-84984 Aug 06 22:12:49.970874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-05bd609b-e98b-496b-847d-5a3b434afcd9 req-8bce7a38-b993-44f5-80e3-024ae7d8fa67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042203 Aug 06 22:12:49.971876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 163/327] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:50.536516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:50.537292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:50.546849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:50.547568 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:50.548196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:50.549131 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:50.549767 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:50.550405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:50.705806 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:50.714283 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-71a79819-9055-4052-ae40-02fd51530a28 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.183431 Aug 06 22:12:50.714916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 165/328] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:50 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:50.770674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:50.778076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] [instance: 48146962-975b-459d-b6c6-a228551ad99b] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:50.780025 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:50.780726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:50.781346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:50.787982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:50.788485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:50.788927 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:50.804712 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] HTTP exception thrown: Instance 48146962-975b-459d-b6c6-a228551ad99b could not be found. Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Request method failure captured: Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b HTTP/1.1 Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ucbjnUGbCQN92ZL5pJI-DsVp0FsYuspeC8VzBHFJmMpWjgeo8Qt3u43ajzgz8q1zk1SJhzBoE4qAQhKi7Lk-IL4Oi3SsyrBMXOLc-3-dKkEj5rHu-GtKxvicSuKmH5H8Zr3AdHiQu6Y0mLOxSbFfdA7z1vEjDtkhofR8563OE039CI Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 6cc6b84f1fcc4e28b7c3a7547b6640b8 Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-VolumesActionsTest-937455463 Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:12:50.806978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6cc6b84f1fcc4e28b7c3a7547b6640b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6cc6b84f1fcc4e28b7c3a7547b6640b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6cc6b84f1fcc4e28b7c3a7547b6640b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6cc6b84f1fcc4e28b7c3a7547b6640b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-VolumesActionsTest-937455463 Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 6cc6b84f1fcc4e28b7c3a7547b6640b8 Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-VolumesActionsTest-937455463 Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-VolumesActionsTest-937455463-project Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 26b6e4a0640548dd8d6bb800d1f26b95 Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-VolumesActionsTest-937455463-project Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 48146962-975b-459d-b6c6-a228551ad99b could not be found. Aug 06 22:12:50.808519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '48146962-975b-459d-b6c6-a228551ad99b'} Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48146962-975b-459d-b6c6-a228551ad99b could not be found. Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:12:50.809401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48146962-975b-459d-b6c6-a228551ad99b could not be found. Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48146962-975b-459d-b6c6-a228551ad99b could not be found. Aug 06 22:12:50.810675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:12:50.811715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] Returning 404 to user: Instance 48146962-975b-459d-b6c6-a228551ad99b could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:12:50.811715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c2ada16e-5b87-4a56-859e-7db9b2f42fec tempest-VolumesActionsTest-937455463 tempest-VolumesActionsTest-937455463-project] 10.222.0.18 "GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b" status: 404 len: 111 microversion: 2.1 time: 0.043076 Aug 06 22:12:50.814291 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 164/329] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:50 2022] GET /compute/v2.1/servers/48146962-975b-459d-b6c6-a228551ad99b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:12:51.735485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:51.736088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:51.742814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:51.743295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:51.743721 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:51.744550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:51.744957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:51.745392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:51.902695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:51.910223 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6a4fb2ee-e352-44c1-a918-f17a903e960b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.178983 Aug 06 22:12:51.910811 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 166/330] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:51 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:51.988545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-65e4bea2-217e-4873-97d5-e67124633b9e req-e349629d-3837-4b5a-820f-cdf7dc045105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9f579b-0319-4f10-8add-f6841dff2c15", "tag": "ead8bbbb-85ad-4109-8f01-4cebf7430d97"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:12:51.998908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-65e4bea2-217e-4873-97d5-e67124633b9e req-e349629d-3837-4b5a-820f-cdf7dc045105 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:52.000098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-65e4bea2-217e-4873-97d5-e67124633b9e req-e349629d-3837-4b5a-820f-cdf7dc045105 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:52.000098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-65e4bea2-217e-4873-97d5-e67124633b9e req-e349629d-3837-4b5a-820f-cdf7dc045105 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:52.011180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-65e4bea2-217e-4873-97d5-e67124633b9e req-e349629d-3837-4b5a-820f-cdf7dc045105 service nova] Creating event network-changed:ead8bbbb-85ad-4109-8f01-4cebf7430d97 for instance ea9f579b-0319-4f10-8add-f6841dff2c15 on hv-cinder-84984 Aug 06 22:12:52.018450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-65e4bea2-217e-4873-97d5-e67124633b9e req-e349629d-3837-4b5a-820f-cdf7dc045105 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033911 Aug 06 22:12:52.024498 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 165/331] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:12:52.931773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:52.932340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:52.934359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:52.939502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:52.939980 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:52.940426 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:52.941134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:52.941584 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:52.942008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:53.088802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:53.096294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2bf98d15-3950-48ac-af0d-0a27dfe5a92b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.168998 Aug 06 22:12:53.096895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 167/332] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:52 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:54.116004 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:54.120803 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:54.121497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:54.127540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:54.128028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:54.128494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:54.129187 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:54.129644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:54.130064 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:54.265239 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:54.272913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-09379c3c-21ed-49c3-8a92-33b981e131df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.158310 Aug 06 22:12:54.284367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 166/333] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:54 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:55.295485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:55.296096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:55.302732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:55.303150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:55.303585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:55.304299 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:55.304787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:55.305210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:55.437588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:55.444874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f7fb912e-7cac-46e0-bbc2-20d738083548 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.153646 Aug 06 22:12:55.445425 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 168/334] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:55 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:56.466923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:56.467534 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:56.469732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=28 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:12:56.475180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:56.475931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:56.476368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:56.477098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:56.477554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:56.477981 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:56.607121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:56.614750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5437fd1b-8143-4726-8b7b-44c59a3a36b3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.152755 Aug 06 22:12:56.615310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 167/335] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:56 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:57.635820 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:57.636355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:57.643105 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:57.643587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:57.644022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:57.644740 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:57.645195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:57.645617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:57.778227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:57.785668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7264ba54-2d84-4de2-8304-802f2ffdb94a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.154520 Aug 06 22:12:57.786223 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 169/336] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:57 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:58.806630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:58.807386 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:58.813946 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:58.814417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:58.814845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:58.815520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:58.815965 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:58.816383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:58.951381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:12:58.958650 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ef6d0f64-020e-4674-b020-0a2ff3814628 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.156237 Aug 06 22:12:58.959209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 168/337] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:58 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:12:59.979414 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:12:59.980020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:12:59.986376 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:59.986854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:59.987287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:12:59.988000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:12:59.988433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:12:59.988863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:00.252033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:00.259404 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-262f592e-c9f7-45a4-8fd0-96009873edd7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.284243 Aug 06 22:13:00.260661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 170/338] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:12:59 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:01.280372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:01.281125 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:01.287790 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:01.288279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:01.288762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:01.289562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:01.290034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:01.290461 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:01.426779 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:01.434037 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-61d90e85-0ca6-480d-8c50-019fb778ffc9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.157592 Aug 06 22:13:01.436298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 169/339] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:01 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:02.454795 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:02.455324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:02.461652 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:02.462133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:02.462588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:02.463261 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:02.463706 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:02.464122 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:02.588823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:02.596101 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a0f5364a-1437-4d12-9160-784a7de0dbb4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.145160 Aug 06 22:13:02.596691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 171/340] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:02 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:03.618335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:03.619742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:03.626757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:03.627234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:03.627663 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:03.628347 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:03.628820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:03.629234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:03.760767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:03.768073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a97da869-b6cc-4767-8d23-d3a129873769 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.153566 Aug 06 22:13:03.768645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 170/341] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:03 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:04.788637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:04.789234 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:04.796069 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:04.796582 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:04.797013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:04.797692 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:04.798136 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:04.798553 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:04.924687 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:04.932519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c6772312-50fd-45f6-bb65-123b31c7a98c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.147652 Aug 06 22:13:04.933063 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 172/342] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:04 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:05.953219 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:05.953851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:05.960227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:05.960747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:05.961176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:05.961858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:05.962420 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:05.962858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:06.094184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:06.101869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-786089f6-bf61-4e91-bd48-17e71a17f10a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.152449 Aug 06 22:13:06.102415 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 171/343] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:05 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:07.122810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:07.123342 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:07.125696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:07.130370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:07.130855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:07.131290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:07.131977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:07.132451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:07.132875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:07.281921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:07.289793 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a0871199-3766-4de1-bcb3-d44ae7fedc24 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.171661 Aug 06 22:13:07.291377 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 173/344] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:07 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:07.572761 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-40fe88c8-dcd1-4eda-adb0-ae3f3e7355d9 req-b119e0dd-f4a6-4a96-94a5-2016d58238e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fe6d06-81d1-46d4-a10a-54fc6d97cea9", "name": "network-vif-plugged", "status": "completed", "tag": "af724266-6923-4b34-aa57-73b075c36dc5"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:13:07.583447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-40fe88c8-dcd1-4eda-adb0-ae3f3e7355d9 req-b119e0dd-f4a6-4a96-94a5-2016d58238e3 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:07.584011 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-40fe88c8-dcd1-4eda-adb0-ae3f3e7355d9 req-b119e0dd-f4a6-4a96-94a5-2016d58238e3 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:07.584476 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-40fe88c8-dcd1-4eda-adb0-ae3f3e7355d9 req-b119e0dd-f4a6-4a96-94a5-2016d58238e3 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:07.597012 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-40fe88c8-dcd1-4eda-adb0-ae3f3e7355d9 req-b119e0dd-f4a6-4a96-94a5-2016d58238e3 service nova] Creating event network-vif-plugged:af724266-6923-4b34-aa57-73b075c36dc5 for instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 on hv-cinder-84984 Aug 06 22:13:07.602576 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-40fe88c8-dcd1-4eda-adb0-ae3f3e7355d9 req-b119e0dd-f4a6-4a96-94a5-2016d58238e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034001 Aug 06 22:13:07.603392 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 172/345] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:13:08.314471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:08.315891 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:08.323630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:08.324178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:08.324697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:08.325434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:08.326258 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:08.326993 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:08.483059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:08.490889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6daf35a0-d418-44c3-b3b7-c338cc3e533c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.180992 Aug 06 22:13:08.491744 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 174/346] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:08 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:09.513289 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:09.514656 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:09.521583 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:09.522147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:09.522808 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:09.523596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:09.524433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:09.525080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:09.669541 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:09.678116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9ce4e088-4c6d-492a-a5a4-d65b7ac4e6df tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.170148 Aug 06 22:13:09.678961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 173/347] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:09 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:10.699184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:10.699791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:10.706510 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:10.706991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:10.707428 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:10.708107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:10.708592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:10.709014 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:10.862165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:10.870754 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1c1c900b-4e24-4dbb-b74b-355e29ee6612 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.175600 Aug 06 22:13:10.871602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 175/348] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:10 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:11.891826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:11.892672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:11.895206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:11.904312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:11.904857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:11.905288 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:11.905984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:11.906616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:11.907036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:12.057048 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:12.065484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-00c35286-cefd-4e0c-a2f2-f7be5bea826d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.177354 Aug 06 22:13:12.066671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 174/349] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:11 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:13.086693 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:13.088134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:13.095487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:13.095997 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:13.096458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:13.097179 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:13.097640 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:13.098071 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:13.249638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:13.257985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-04221195-2ccc-437a-a2e9-e6327b104efc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.175565 Aug 06 22:13:13.272652 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 176/350] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:13 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:14.284968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:14.286229 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:14.293756 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:14.294279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:14.294895 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:14.296319 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:14.296962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:14.297395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:14.430377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:14.438230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3f6f4a5e-a1ed-486e-9def-ffe14cbaca52 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.157493 Aug 06 22:13:14.439069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 175/351] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:14 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:15.460612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:15.462600 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:15.471316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:15.472208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:15.472763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:15.473939 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:15.474659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:15.475505 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:15.640416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:15.649045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-92470078-c5fe-4a6c-855b-53db01589ae2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.193551 Aug 06 22:13:15.658751 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 177/352] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:15 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:16.671159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:16.672666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:16.680193 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:16.681555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:16.682268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:16.683138 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:16.683778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:16.684209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:16.829210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:16.837172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-906ec1d8-cd90-457c-bb43-2f903a20f7fc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.170171 Aug 06 22:13:16.837897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 176/353] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:16 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:17.044658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-2c149b20-5268-43b1-b769-8a0515f4a1a9 req-598ac06a-ede6-4940-a05f-718cb1827e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9f579b-0319-4f10-8add-f6841dff2c15", "name": "network-vif-plugged", "status": "completed", "tag": "ead8bbbb-85ad-4109-8f01-4cebf7430d97"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:13:17.062222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-2c149b20-5268-43b1-b769-8a0515f4a1a9 req-598ac06a-ede6-4940-a05f-718cb1827e47 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:17.062698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-2c149b20-5268-43b1-b769-8a0515f4a1a9 req-598ac06a-ede6-4940-a05f-718cb1827e47 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:17.063119 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-2c149b20-5268-43b1-b769-8a0515f4a1a9 req-598ac06a-ede6-4940-a05f-718cb1827e47 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:17.079418 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-2c149b20-5268-43b1-b769-8a0515f4a1a9 req-598ac06a-ede6-4940-a05f-718cb1827e47 service nova] Creating event network-vif-plugged:ead8bbbb-85ad-4109-8f01-4cebf7430d97 for instance ea9f579b-0319-4f10-8add-f6841dff2c15 on hv-cinder-84984 Aug 06 22:13:17.090265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-2c149b20-5268-43b1-b769-8a0515f4a1a9 req-598ac06a-ede6-4940-a05f-718cb1827e47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044668 Aug 06 22:13:17.092809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 178/354] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:13:17.857940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:17.858827 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:17.869588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:17.871069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:17.872220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:17.873721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:17.874772 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:17.875586 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:18.047292 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:18.055220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-746ecd53-d793-4bad-b2b7-e891e64c2ec8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.201133 Aug 06 22:13:18.056273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 177/355] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:17 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:19.077896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:19.079427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:19.086346 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:19.086864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:19.087300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:19.088119 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:19.088614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:19.089310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:19.255220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:19.261469 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:19.266145 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9a39e779-0afa-4557-a139-0dba756d2c5c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.192632 Aug 06 22:13:19.279666 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 179/356] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:19 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:20.286743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:20.287360 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:20.294681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:20.295233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:20.295728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:20.296535 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:20.297058 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:20.297573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:20.460686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:20.470189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5eaa33e0-f662-4818-9aeb-b704d9dce8b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.187107 Aug 06 22:13:20.471062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 178/357] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:20 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:21.492305 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:21.493082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:21.499747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:21.500302 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:21.500940 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:21.501697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:21.502211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:21.502690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:21.661549 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:21.670929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-33039d58-7360-40dd-9475-72b852598940 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.183540 Aug 06 22:13:21.671510 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 180/358] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:21 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:22.697594 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:22.698200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:22.705354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:22.705836 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:22.706268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:22.706957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:22.707404 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:22.707820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:22.711500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=89 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:22.887107 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:22.894841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-92a0c296-59e9-43cc-9bad-40e22767bf9e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.201544 Aug 06 22:13:22.895782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 179/359] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:22 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:23.915741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:23.916335 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:23.922769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:23.923251 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:23.923680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:23.924360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:23.924832 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:23.925254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:24.059433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:24.066845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ac02139a-52f7-4e14-b710-87016ff0ee84 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.155021 Aug 06 22:13:24.067405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 181/360] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:23 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:25.088156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:25.088794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:25.095140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:25.095624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:25.096059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:25.096792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:25.097253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:25.097676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:25.226432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:25.234253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2af82061-b41f-4487-93d9-961c797cea4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.150198 Aug 06 22:13:25.234805 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 180/361] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:25 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:26.255017 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:26.255621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:26.262770 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:26.263285 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:26.263718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:26.264422 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:26.264881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:26.265303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:26.398092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:26.405582 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-711823f5-9d05-4506-b725-b2239f910325 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.154353 Aug 06 22:13:26.406127 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 182/362] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:26 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:27.426453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:27.427052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:27.434057 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:27.434561 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:27.435018 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:27.435691 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:27.436135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:27.436600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:27.565409 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:27.573249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-da40b776-9ac0-4931-ad84-6b4fe522ba58 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.150954 Aug 06 22:13:27.573795 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 181/363] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:27 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:28.595211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:28.595923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:28.603374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:28.604550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:28.604550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:28.605052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:28.605545 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:28.605916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:28.739788 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:28.750504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-847a5106-3be4-4fd3-b2d7-3dfe075f6eb0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.159114 Aug 06 22:13:28.751383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 183/364] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:28 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:29.771851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:29.772674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:29.779805 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:29.780295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:29.780791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:29.781469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:29.781926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:29.782350 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:29.834083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-763338055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-355030664", "security_groups": [{"name": "tempest-secgroup-smoke-241697632"}], "networks": [{"uuid": "66fc1dea-8a58-4544-b899-8be862d20077"}], "block_device_mapping_v2": [{"uuid": "253ad7b8-1ea1-4d46-a21f-d37573b0c328", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:13:29.980107 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:29.988223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8a79e795-054d-4501-b138-e4dccc7f76f0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1321 microversion: 2.1 time: 0.220143 Aug 06 22:13:29.989105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 182/365] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:29 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:29.994088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] validate_networks() for [('66fc1dea-8a58-4544-b899-8be862d20077', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:13:30.378635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:13:30.379056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:13:30.379525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:13:30.379931 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:13:30.380340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:13:30.389984 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:30.390459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:30.390882 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:30.391595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:30.392037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:30.392476 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:30.410073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Getting quotas for project 6354597f8edf4ebc9539a33314e6bc06. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:13:30.418177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Getting quotas for user 9469cd012c2549288ba403902b667295 and project 6354597f8edf4ebc9539a33314e6bc06. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:13:30.476231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:13:30.478605 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='253ad7b8-1ea1-4d46-a21f-d37573b0c328',volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:13:31.010111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:31.010718 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:31.017071 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:31.017552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:31.017982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:31.018672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:31.019208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:31.019703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:31.152150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:31.159688 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4725de76-51a3-4ee3-94f2-b2f148fd7708 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1516 microversion: 2.1 time: 0.154215 Aug 06 22:13:31.160776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 183/366] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:31 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:31.181391 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:13:31.183539 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:31.189639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:31.190117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:31.190543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:31.191228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:31.191674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:31.192090 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:31.214434 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lazy-loading 'flavor' on Instance uuid ea9f579b-0319-4f10-8add-f6841dff2c15 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:13:31.284857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-20680463-8d32-4cd9-b9b3-0a02f089411b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.455579 Aug 06 22:13:31.286092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 184/367] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:13:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 22:13:31.297620 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ed32b787-f81a-4ba4-b6ed-4a962a27470c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:31.298151 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ed32b787-f81a-4ba4-b6ed-4a962a27470c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:31.356359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ed32b787-f81a-4ba4-b6ed-4a962a27470c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:31.363426 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ed32b787-f81a-4ba4-b6ed-4a962a27470c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1087 microversion: 2.1 time: 0.069450 Aug 06 22:13:31.364301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 185/368] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:31 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:31.602418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-841a7e3d-35bf-4d1e-b90c-a9d4afbaa888 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15/action" status: 200 len: 32 microversion: 2.1 time: 0.424843 Aug 06 22:13:31.608714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 184/369] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:13:31 2022] POST /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15/action => generated 32 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 22:13:31.612277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:31.612993 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:31.619068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:31.619555 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:31.619985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:31.620696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:31.621149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:31.621572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:31.750137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:31.757763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e2d14ca4-feaa-4de9-b20e-71c90552f405 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.149295 Aug 06 22:13:31.758915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 186/370] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:31 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:32.386897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6bcd7e1b-f250-4b56-a088-ef7c31d2a271 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:32.387587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6bcd7e1b-f250-4b56-a088-ef7c31d2a271 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:32.439694 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6bcd7e1b-f250-4b56-a088-ef7c31d2a271 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:32.447931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6bcd7e1b-f250-4b56-a088-ef7c31d2a271 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1087 microversion: 2.1 time: 0.065922 Aug 06 22:13:32.448494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 185/371] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:32 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1087 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:32.779142 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:32.779804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:32.786503 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:32.786979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:32.787404 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:32.788079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:32.788553 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:32.789575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:32.918708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:32.926406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d34b4501-7fba-4bb6-b1eb-4cf196f73b93 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.150925 Aug 06 22:13:32.926965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 187/372] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:32 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:33.468536 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:33.469131 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:33.476005 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:33.476617 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:33.477190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:33.477962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:33.478442 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:33.478863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:33.538809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:33.546141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-60b0e666-8a27-4f56-a89e-3ea9e789dc6a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1137 microversion: 2.1 time: 0.081555 Aug 06 22:13:33.546692 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 186/373] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:33 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:33.948140 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:33.948681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:33.955053 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:33.955526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:33.955957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:33.956663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:33.957110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:33.957522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:34.084924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:34.093294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7ebf8e39-dd42-4daf-ac93-f8a100f1e4ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.149864 Aug 06 22:13:34.093850 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 188/374] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:33 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:34.566349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:34.566879 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:34.573305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:34.573775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:34.574198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:34.574872 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:34.575316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:34.575729 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:34.637989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:34.645280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3288dbd1-9792-4658-a5d0-3feb38db6185 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1137 microversion: 2.1 time: 0.082793 Aug 06 22:13:34.645831 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 187/375] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:34 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:35.115457 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:35.116090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:35.122956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:35.123431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:35.123881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:35.124567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:35.125013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:35.125431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:35.254080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:35.262161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2c5e9b6e-8b3c-4708-b943-22caf641be15 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.150525 Aug 06 22:13:35.262722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 189/376] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:35 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:35.667116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:35.667665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:35.674306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:35.674794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:35.675233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:35.675951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:35.676434 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:35.676881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:35.737893 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:35.746036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-31692112-c0e6-43bc-bdbf-912289b19327 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1129 microversion: 2.1 time: 0.083369 Aug 06 22:13:35.746595 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 188/377] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:35 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1129 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:36.283230 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:36.284143 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:36.291099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:36.291589 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:36.292025 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:36.292907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:36.293539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:36.294698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:36.451471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:36.463231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-07f40f82-5dc1-4f90-b035-dc33aefc6920 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.183972 Aug 06 22:13:36.478487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 190/378] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:36 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:36.776368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:36.777141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:36.794134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:36.794134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:36.794134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:36.794734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:36.795276 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:36.795777 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:37.098282 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:37.106839 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-767b3cd8-caf5-495b-aef9-d22692d31838 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1185 microversion: 2.1 time: 0.343595 Aug 06 22:13:37.107429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 189/379] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:36 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1185 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:37.487117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:37.487717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:37.490026 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:37.494826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:37.495355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:37.495783 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:37.496491 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:37.496941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:37.497359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:37.630067 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:37.639446 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-37a95067-5638-458e-b89c-dffd5a4e0df4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.155976 Aug 06 22:13:37.640552 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 191/380] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:37 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:38.128687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:38.129277 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:38.136847 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:38.137245 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:38.137684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:38.138814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:38.139268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:38.139691 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:38.208919 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:38.216747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-42511697-0930-4c5f-b46a-d09ec0af5017 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1203 microversion: 2.1 time: 0.091955 Aug 06 22:13:38.217600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 190/381] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:38 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1203 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:38.661780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:38.662504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:38.672004 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:38.672572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:38.673925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:38.681973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:38.681973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:38.681973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:38.826365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:38.833957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-071de32a-e434-49ba-85e4-ec73b2cf32b2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.176026 Aug 06 22:13:38.834530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 192/382] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:38 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:39.238238 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:39.238844 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:39.245447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:39.245789 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:39.246267 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:39.247023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:39.247474 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:39.247889 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:39.389200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:39.396556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5c1e38b8-7ae0-4b16-82fa-53eb83affc3c tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1270 microversion: 2.1 time: 0.162002 Aug 06 22:13:39.397118 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 191/383] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:39 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:39.855821 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:39.856441 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:39.862810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:39.863329 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:39.863755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:39.864459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:39.864910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:39.866564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:39.994913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:40.002346 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-113e48cd-33c0-4872-bdf4-b18ebdfcb22a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.151168 Aug 06 22:13:40.004156 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 193/384] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:39 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:40.417506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:40.418069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:40.424648 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:40.425132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:40.425565 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:40.426254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:40.426709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:40.427135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:40.558254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:40.566046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f45812d5-9e98-4708-9c80-514cc3ef66d8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1270 microversion: 2.1 time: 0.152952 Aug 06 22:13:40.566615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 192/385] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:40 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:41.023781 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:41.024380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:41.026239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:41.031383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:41.031858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:41.032295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:41.033003 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:41.033450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:41.033864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:41.162070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:41.169801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5a5479e5-27b6-4dfe-aa3c-b8edd942556f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.150560 Aug 06 22:13:41.170342 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 194/386] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:41 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:41.586723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:41.587327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:41.593706 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:41.594182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:41.594613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:41.595290 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:41.595733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:41.596169 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:41.728154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:41.735607 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bceefba3-0531-41e6-a321-709967756a82 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1270 microversion: 2.1 time: 0.152709 Aug 06 22:13:41.736168 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 193/387] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:41 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:42.192239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:42.193088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:42.196937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=8 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:42.201499 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:42.201987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:42.202419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:42.203111 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:42.203561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:42.204270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:42.339226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:42.346735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-80f6c97b-8e38-4ad1-99d7-3a0c19eca2b4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.158679 Aug 06 22:13:42.347311 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 195/388] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:42 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:42.567975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-f0b0f37d-963f-4b71-9faa-de29c21f7718 req-475c0c1a-f610-42b5-a986-31d7c8495185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf8ec91-febf-4f9e-a540-08f48c5baae8", "tag": "a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:13:42.573408 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:42.579039 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f0b0f37d-963f-4b71-9faa-de29c21f7718 req-475c0c1a-f610-42b5-a986-31d7c8495185 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:42.579532 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f0b0f37d-963f-4b71-9faa-de29c21f7718 req-475c0c1a-f610-42b5-a986-31d7c8495185 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:42.581964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f0b0f37d-963f-4b71-9faa-de29c21f7718 req-475c0c1a-f610-42b5-a986-31d7c8495185 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:42.591153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-f0b0f37d-963f-4b71-9faa-de29c21f7718 req-475c0c1a-f610-42b5-a986-31d7c8495185 service nova] Creating event network-changed:a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e for instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 on hv-cinder-84984 Aug 06 22:13:42.596020 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-f0b0f37d-963f-4b71-9faa-de29c21f7718 req-475c0c1a-f610-42b5-a986-31d7c8495185 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031681 Aug 06 22:13:42.596864 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 194/389] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:13:42.758150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:42.758761 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:42.765495 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:42.766024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:42.766484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:42.773898 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:42.773898 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:42.773898 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:42.910653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:42.919046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-03208322-9649-44ed-8f7a-c3fd092d07f2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1270 microversion: 2.1 time: 0.164759 Aug 06 22:13:42.919615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 196/390] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:42 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:43.369715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:43.370450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:43.377561 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:43.378049 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:43.379019 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:43.379414 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:43.379942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:43.380373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:43.397074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:43.531982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:43.539428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ff4ccb31-f158-47f5-9280-7d4b9473446c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.174465 Aug 06 22:13:43.540044 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 195/391] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:43 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:43.940638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:43.941250 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:43.947618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:43.948097 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:43.948562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:43.949249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:43.949699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:43.950118 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:44.089473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:44.097161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f638207b-3106-45c3-9e12-ef7e7ae1474d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1270 microversion: 2.1 time: 0.160339 Aug 06 22:13:44.097719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 197/392] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:43 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:44.561856 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:44.562466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:44.565333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=46 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:44.570316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:44.577117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:44.577117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:44.577117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:44.577117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:44.577475 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:44.714977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:44.722670 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1fe4e378-131b-4bb2-9b3b-5cf07313f098 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.164715 Aug 06 22:13:44.723734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 196/393] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:44 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:45.119394 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:45.120052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:45.126670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:45.127152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:45.127722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:45.128419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:45.128881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:45.129297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:45.133343 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:45.266177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:45.273837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6529ff12-8dd3-4742-973e-84a66f56d6ba tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.158835 Aug 06 22:13:45.274376 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 198/394] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:45 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:45.744429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:45.745617 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:45.752501 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:45.752987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:45.753424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:45.754237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:45.754688 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:45.755106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:45.896088 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:45.904816 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e142a6e4-368b-4068-9478-18cbf26c91f9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.164304 Aug 06 22:13:45.905316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 197/395] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:45 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:46.296364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:46.297051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:46.303512 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:46.303990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:46.304445 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:46.305136 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:46.305586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:46.306642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:46.442125 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:46.452286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1a2fbe12-13cc-4108-9c41-e412dd46f5dd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.160117 Aug 06 22:13:46.452977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 199/396] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:46 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:46.925938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:46.926754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:46.933491 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:46.933974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:46.934404 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:46.935115 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:46.935562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:46.936010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:47.073460 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:47.074038 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:47.079922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:47.080429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:47.080878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:47.081697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:47.082159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:47.082581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:47.121825 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:47.129362 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-01ef9b6b-4ba4-49eb-a819-4153df4fdc25 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.207447 Aug 06 22:13:47.129916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 198/397] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:46 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:47.209877 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lazy-loading 'services' on Instance uuid 898f71d4-ea33-4d80-bad4-530206ed71d3 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:13:47.473961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:47.474559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:47.481660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:47.482225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:47.482731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:47.483580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:47.484102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:47.484623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:47.491878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-695a2022-4cdb-44b9-8024-e038fe9b11a8 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "DELETE /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3/os-volume_attachments/a4d17749-87ac-487e-a9f1-52147608e29d" status: 202 len: 0 microversion: 2.1 time: 0.422115 Aug 06 22:13:47.494278 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 200/398] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:13:47 2022] DELETE /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3/os-volume_attachments/a4d17749-87ac-487e-a9f1-52147608e29d => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 22:13:47.667723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:47.676586 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f871841c-5094-4bc5-8ab8-92f1f538f0b9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.206639 Aug 06 22:13:47.689845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 199/399] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:47 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:48.158997 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:48.160332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:48.172220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:48.173093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:48.173879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:48.175155 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:48.179391 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:48.180165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:48.485160 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:48.494814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3300e1d8-cd55-4af8-ac9b-d26ae1f8e24f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.346603 Aug 06 22:13:48.508863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 201/400] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:48 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:48.702509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:48.704704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:48.715469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:48.716740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:48.717177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:48.717964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:48.718416 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:48.718837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:48.943649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:48.951893 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3674a40c-936d-4fa6-bc76-a1befdefd40f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.256424 Aug 06 22:13:48.952638 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 200/401] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:48 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:49.517867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:49.518471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:49.530198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:49.530697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:49.531308 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:49.532028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:49.532609 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:49.533264 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:49.723978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:49.725472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:49.732914 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:49.733407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:49.733843 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:49.734545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:49.735000 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:49.735425 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:49.776952 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:13:49.972325 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:49.980876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d9911984-030c-43df-8fe5-9d2922a407a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.468565 Aug 06 22:13:49.981454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 202/402] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:49 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:49.997349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:49.997998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:50.005332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:50.014857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:50.014857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:50.014857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:50.026012 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:50.026547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:50.179968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-821e20db-f48e-4d3e-8b7b-6800a2011974 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "DELETE /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 204 len: 0 microversion: 2.1 time: 0.459531 Aug 06 22:13:50.181929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:50.184230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 201/403] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:13:49 2022] DELETE /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 22:13:50.195483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7ec24602-cff5-48a9-b497-e72fc06e3e2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.212725 Aug 06 22:13:50.197660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 203/404] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:49 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:50.199118 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:50.200590 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:50.216434 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:50.216948 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:50.217411 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:50.218360 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:50.218833 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:50.219242 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:50.370846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:50.379373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-23d2bc3b-1361-4fae-94d3-fa612eef398c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1512 microversion: 2.1 time: 0.193587 Aug 06 22:13:50.380673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 202/405] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:50 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:51.004252 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:51.039450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:51.039450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:51.039450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:51.039450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:51.041153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:51.041153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:51.041153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:51.187124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:51.198428 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d64c414e-ed6e-47ad-ae4e-7842a18e6f39 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.198800 Aug 06 22:13:51.199014 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 204/406] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:50 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:51.221621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:51.222265 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:51.230559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:51.231043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:51.231540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:51.232240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:51.232716 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:51.235540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:51.394281 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:51.402682 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7ed2b0f2-df1c-498b-bf42-5437042500cc tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.184768 Aug 06 22:13:51.402881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:51.403929 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 203/407] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:51 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:51.404660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:51.411277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:51.412128 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:51.412785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:51.413669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:51.414290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:51.414934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:51.583401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:51.597245 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-91eeeb1b-dee3-46cf-af92-b09e98131eae tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1512 microversion: 2.1 time: 0.201046 Aug 06 22:13:51.607400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 205/408] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:51 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:52.219915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:52.220894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:52.234182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:52.235600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:52.236137 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:52.236976 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:52.239114 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:52.239799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:52.389631 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:52.398178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-12af823b-ad1f-40a0-b3ec-19623141ede9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.182837 Aug 06 22:13:52.399286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 204/409] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:52 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:52.426696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:52.427695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:52.434476 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:52.434989 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:52.435349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:52.436097 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:52.436512 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:52.436907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:52.582828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:52.590544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0db5f4a8-5c3b-4db5-bc31-4458ff8a8712 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.168006 Aug 06 22:13:52.591098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 206/410] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:52 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:52.621655 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:52.622255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:52.628355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:52.628794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:52.629333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:52.629894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:52.630339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:52.630789 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:52.777867 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:52.786380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3433cc11-db90-45e6-a0d1-49567a3d674d tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1512 microversion: 2.1 time: 0.169382 Aug 06 22:13:52.787032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 205/411] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:52 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:52.980870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:13:52.981254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:13:53.419945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:53.420914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:53.428437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:53.429638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:53.430072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:53.430990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:53.431585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:53.432173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:53.583416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:53.592136 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-030e2612-663d-4bd7-a937-777183b584b9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.176679 Aug 06 22:13:53.592725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 207/412] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:53 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:53.613148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:53.614430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:53.625788 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:53.626653 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:53.628752 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:53.629675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:53.630481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:53.631166 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:53.786442 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:53.796851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-66a28a52-920a-47e6-8b95-a047e22e5750 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.187982 Aug 06 22:13:53.809130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 206/413] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:53 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:53.815593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:53.816779 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:53.830510 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:53.831779 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:53.832368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:53.833255 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:53.833701 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:53.834278 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:53.978150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:53.985800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-364ec6a8-acc3-410b-8ab1-24f02a0bc300 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1512 microversion: 2.1 time: 0.175522 Aug 06 22:13:53.986355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 208/414] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:53 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:54.619694 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:54.622399 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:54.642074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:54.642575 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:54.643016 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:54.643739 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:54.644195 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:54.644746 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:54.818972 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:54.819715 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:54.830860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:54.836966 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:54.837122 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:54.838674 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:54.839497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:54.847233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:54.847756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:54.847893 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-20bb5a91-e4ba-47cf-8ffa-2be5536a8709 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.236820 Aug 06 22:13:54.848344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 207/415] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:54 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:55.010349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:55.010972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:55.021292 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:55.031435 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:55.031901 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:55.035201 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:55.035629 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:55.036080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:55.153489 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:55.177408 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c5740a75-cf1a-46f6-9e5e-22dcfb1cb84c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1470 microversion: 2.1 time: 0.170468 Aug 06 22:13:55.201453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 208/416] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:55 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:55.206953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-9791f9cc-cc79-4eff-a417-6a5f0f264879 req-19d1d283-347e-4986-be05-1fc195ee4598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898f71d4-ea33-4d80-bad4-530206ed71d3", "name": "network-vif-deleted", "tag": "1a3e64fb-c256-48a6-a0eb-0dfe19d53b3a"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:13:55.210740 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:55.219236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-9791f9cc-cc79-4eff-a417-6a5f0f264879 req-19d1d283-347e-4986-be05-1fc195ee4598 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:55.219383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e1b3fd71-4d8b-4c49-8736-5a6b141a5932 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.404199 Aug 06 22:13:55.220340 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-9791f9cc-cc79-4eff-a417-6a5f0f264879 req-19d1d283-347e-4986-be05-1fc195ee4598 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:55.221124 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-9791f9cc-cc79-4eff-a417-6a5f0f264879 req-19d1d283-347e-4986-be05-1fc195ee4598 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:55.225215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 209/417] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:54 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:55.240614 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-9791f9cc-cc79-4eff-a417-6a5f0f264879 req-19d1d283-347e-4986-be05-1fc195ee4598 service nova] Creating event network-vif-deleted:1a3e64fb-c256-48a6-a0eb-0dfe19d53b3a for instance 898f71d4-ea33-4d80-bad4-530206ed71d3 on hv-cinder-84984 Aug 06 22:13:55.256250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-9791f9cc-cc79-4eff-a417-6a5f0f264879 req-19d1d283-347e-4986-be05-1fc195ee4598 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053082 Aug 06 22:13:55.257273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 209/418] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:13:55.869404 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:55.870763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:55.892545 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:55.896539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:55.898509 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:55.905165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:55.905988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:55.906876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:56.189784 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:56.206537 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:56.207244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:56.210138 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b7e3730d-1e6a-4289-a61d-56c2dc58392f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.335514 Aug 06 22:13:56.214846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:56.215336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:56.215971 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:56.217137 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:56.217597 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:56.218026 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:56.221461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 210/419] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:55 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:56.253518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:56.254585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:56.261381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:56.262080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:56.262697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:56.263302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lazy-loading 'fault' on Instance uuid 898f71d4-ea33-4d80-bad4-530206ed71d3 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:13:56.268904 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:56.271932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:56.271932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:56.271932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:56.271932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:56.277176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:56.325063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:56.328705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:56.337955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4fd978bb-15a3-4d11-96ac-fa6aae207b0c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 200 len: 1308 microversion: 2.1 time: 0.135903 Aug 06 22:13:56.339792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 210/420] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:56 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 1308 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:56.494859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:56.502610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5757fbed-0a45-4f27-97d5-8a8a09a9a6b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.263525 Aug 06 22:13:56.507100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 211/421] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:56 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:13:57.236294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:57.236294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:57.247352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:57.247852 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:57.248312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:57.249027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:57.249643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:57.250268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:57.362394 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:57.362994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 898f71d4-ea33-4d80-bad4-530206ed71d3] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:57.379979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:57.380515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:57.385094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:57.385933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:57.386413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:57.386843 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] HTTP exception thrown: Instance 898f71d4-ea33-4d80-bad4-530206ed71d3 could not be found. Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Request method failure captured: Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 HTTP/1.1 Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ucixdEE1jyH-3YDZyb-aDoTr2Y7XUGJDEu-Os51OoN_2E98_7d9zFoG9X_Vdic483Thn3r0t_7XrwfIGQM-a_5HJynmhuMMiPBEKvAmRUvoA_eIAZYpbxtw2xYdGOeouZCz2sSEzm5vdWVvipgMWJs-sTJv42apz0_dKVgSzlJrs6w Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: dc2fb805386743d1a4bfd3b15bde695c Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesSnapshotTestJSON-320893733 Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:13:57.434643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dc2fb805386743d1a4bfd3b15bde695c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dc2fb805386743d1a4bfd3b15bde695c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dc2fb805386743d1a4bfd3b15bde695c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dc2fb805386743d1a4bfd3b15bde695c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesSnapshotTestJSON-320893733 Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: dc2fb805386743d1a4bfd3b15bde695c Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-320893733 Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesSnapshotTestJSON-320893733-project Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 56138f43f00e46ea9dda399a0fb0e822 Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesSnapshotTestJSON-320893733-project Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 898f71d4-ea33-4d80-bad4-530206ed71d3 could not be found. Aug 06 22:13:57.436139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '898f71d4-ea33-4d80-bad4-530206ed71d3'} Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 898f71d4-ea33-4d80-bad4-530206ed71d3 could not be found. Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:13:57.436943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 898f71d4-ea33-4d80-bad4-530206ed71d3 could not be found. Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 898f71d4-ea33-4d80-bad4-530206ed71d3 could not be found. Aug 06 22:13:57.440286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:13:57.443438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Returning 404 to user: Instance 898f71d4-ea33-4d80-bad4-530206ed71d3 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:13:57.443438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fd4e1e50-3358-4993-ba4b-842434c5b916 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3" status: 404 len: 111 microversion: 2.1 time: 0.067895 Aug 06 22:13:57.443438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 212/422] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:57 2022] GET /compute/v2.1/servers/898f71d4-ea33-4d80-bad4-530206ed71d3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:13:57.495057 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:57.502867 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0a9437e9-4fb3-4af4-b58b-39d73fde4289 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.273114 Aug 06 22:13:57.515650 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 211/423] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:57 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:57.527638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:57.531896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:57.536633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:57.537340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:57.537941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:57.538745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:57.539273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:57.540250 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:57.718429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:57.727950 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a0771a55-d74a-4524-9912-ca9f13628efa tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.205304 Aug 06 22:13:57.729801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 213/424] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:57 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:58.346057 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-16b814c0-1dba-4c82-8f6c-2e9d5084d67c req-7caaa462-4735-4502-8760-3947e05a3e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf8ec91-febf-4f9e-a540-08f48c5baae8", "name": "network-vif-plugged", "status": "completed", "tag": "a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:13:58.363203 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-16b814c0-1dba-4c82-8f6c-2e9d5084d67c req-7caaa462-4735-4502-8760-3947e05a3e86 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:58.363967 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-16b814c0-1dba-4c82-8f6c-2e9d5084d67c req-7caaa462-4735-4502-8760-3947e05a3e86 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:58.364692 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-16b814c0-1dba-4c82-8f6c-2e9d5084d67c req-7caaa462-4735-4502-8760-3947e05a3e86 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:58.379510 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-16b814c0-1dba-4c82-8f6c-2e9d5084d67c req-7caaa462-4735-4502-8760-3947e05a3e86 service nova] Creating event network-vif-plugged:a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e for instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 on hv-cinder-84984 Aug 06 22:13:58.389905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-16b814c0-1dba-4c82-8f6c-2e9d5084d67c req-7caaa462-4735-4502-8760-3947e05a3e86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048254 Aug 06 22:13:58.390915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 212/425] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:13:58.526270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:58.526835 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:58.534196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:58.538830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:58.538830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:58.538830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:58.538830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:58.539901 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:58.681459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:58.686726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:13:58.692867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b2e56fab-5637-4418-9642-f5a48f53ba91 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.170704 Aug 06 22:13:58.693681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 214/426] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:58 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:58.750606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:58.751525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:58.759556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:58.760030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:58.760487 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:58.761184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:58.761625 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:58.762199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:58.908772 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:58.916534 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-14cb61e5-2275-4744-ac3a-a03a690c86b2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.170152 Aug 06 22:13:58.917097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 213/427] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:58 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:59.715660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:59.716271 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:59.723666 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:59.724148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:59.724616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:59.725565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:59.726018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:59.726437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:59.909809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:13:59.918709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d62481e5-d2f7-4fbc-95e0-3cb97105e47f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.207434 Aug 06 22:13:59.919301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 215/428] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:59 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:13:59.937733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:13:59.943477 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:13:59.946384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:59.947074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:59.947507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:13:59.948243 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:13:59.948728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:13:59.949141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:00.099673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:00.109250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ee37f135-395f-4118-bc94-f84bcfc4a1b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.175387 Aug 06 22:14:00.110194 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 214/429] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:13:59 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:00.941859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:00.942379 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:00.950344 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:00.950836 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:00.951261 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:00.952259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:00.952900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:00.953321 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:01.098373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:01.106218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-78e8bd60-2f66-4c89-aada-7de145c4e11f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.168950 Aug 06 22:14:01.120239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 216/430] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:00 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:01.131071 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:01.131726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:01.139095 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:01.139592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:01.140041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:01.140775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:01.141366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:01.141801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:01.330802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:01.342652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2d1642ae-6030-4038-acc0-2a6204dbbf9a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.215431 Aug 06 22:14:01.343403 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 215/431] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:01 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:02.128859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:02.129497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:02.136534 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:02.137235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:02.137672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:02.138367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:02.138818 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:02.139242 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:02.298917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:02.307393 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6b46bd1e-a892-4d39-9142-870c03f4fce8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.182376 Aug 06 22:14:02.308251 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 217/432] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:02 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:02.369031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:02.369653 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:02.376666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:02.377155 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:02.378331 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:02.379298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:02.379941 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:02.380636 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:02.528353 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:02.540743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-011b6be0-af7e-43db-9b58-ee10832e0a66 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.176641 Aug 06 22:14:02.545380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 216/433] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:02 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:03.329386 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:03.330503 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:03.337738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:03.338301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:03.338799 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:03.339588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:03.340345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:03.340861 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:03.524093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:03.532306 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-96baea56-3abe-406d-a529-4d0bf1722b97 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.206796 Aug 06 22:14:03.533392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 218/434] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:03 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:03.566487 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:03.567136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:03.577426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:03.578203 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:03.580603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:03.581509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:03.582115 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:03.583221 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:03.758714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:03.768032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e424a748-53d6-49fa-bb7f-8ce02bee6397 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.205246 Aug 06 22:14:03.783349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 217/435] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:03 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:04.555880 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:04.557024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:04.568194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:04.568752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:04.569429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:04.571564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:04.572190 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:04.573636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:04.757708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:04.766477 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f299a1e4-de22-4f0d-b7ed-4949f8b9d179 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.215132 Aug 06 22:14:04.767883 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 219/436] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:04 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:04.794850 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:04.795774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:04.803103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:04.803921 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:04.804797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:04.805769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:04.806482 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:04.807129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:04.986487 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:04.994761 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-dd4ae603-c31d-43a0-b8f7-21ed3b35fdce tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.207179 Aug 06 22:14:05.010911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 218/437] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:04 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:05.790306 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:05.791450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:05.798235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:05.798868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:05.799603 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:05.800313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:05.800863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:05.803510 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:05.986604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:05.995575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a75d3a8a-2f5e-4525-bd48-8580468ccdd0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.209915 Aug 06 22:14:05.996797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 220/438] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:05 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:06.015669 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:06.016273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:06.023448 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:06.024196 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:06.024822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:06.025566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:06.026028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:06.026458 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:06.179471 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:06.188253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-96afa732-d35d-40c3-ad6d-209d84301fb9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.176364 Aug 06 22:14:06.188878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 219/439] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:06 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:07.017367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:07.018610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:07.025309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:07.025985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:07.026614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:07.027300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:07.027916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:07.028343 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:07.182497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:07.190697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-46131109-41d2-49df-bca0-402308d1b04f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.177125 Aug 06 22:14:07.192133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 221/440] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:07 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:07.210416 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:07.212694 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:07.222709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:07.223398 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:07.224165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:07.225313 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:07.225917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:07.227228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:07.411092 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:07.425070 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3641ada3-15db-4643-86e0-03704f597695 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1258 microversion: 2.1 time: 0.218774 Aug 06 22:14:07.439298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 220/441] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:07 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:08.214601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:08.215912 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:08.222544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:08.223292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:08.223927 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:08.225126 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:08.225755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:08.226226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:08.392874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:08.401489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c6edb96f-db1e-4c49-86d8-aaba26618a8b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.191818 Aug 06 22:14:08.402608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 222/442] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:08 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:08.446237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:08.447148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:08.454140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:08.454828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:08.455369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:08.456171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:08.456765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:08.457361 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:08.610841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:08.620289 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a6a4525a-b2a9-47ee-9f5d-5c72aa203a2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1442 microversion: 2.1 time: 0.178029 Aug 06 22:14:08.620976 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 221/443] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:08 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1442 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:08.643459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:08.649510 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:08.651566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:08.652249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:08.652865 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:08.653741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:08.654357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:08.654780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:08.803825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:08.812310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cc18b296-5ace-47ab-a23e-9b01f81547cd tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1442 microversion: 2.1 time: 0.172990 Aug 06 22:14:08.812910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 223/444] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:08 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1442 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:09.423796 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:09.425081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:09.431916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:09.432433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:09.432862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:09.433577 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:09.434029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:09.434451 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:09.618110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:09.618110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d201a6ed-23b3-448c-8082-a208a8ec27b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.187715 Aug 06 22:14:09.618110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 222/445] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:09 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:10.639846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:10.641200 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:10.643728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=66 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:10.649936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:10.650462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:10.651166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:10.651897 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:10.652358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:10.652813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:10.801417 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:10.809763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7d5716a1-4cd4-479c-a842-eebb03c692b6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.173823 Aug 06 22:14:10.810336 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 224/446] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:10 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:11.259748 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5f14bba0-cb42-425e-9d4c-1a02d435efeb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Action: 'create', calling method: .version_select at 0x7f30c6b67d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1006183456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkG1n0mqRZfglX7xrKIZVwe2l09Soxwg37U2DO0zGi4QfhEszQLfNwWk/adqO/CT2rlRTTAgjhDRq4xpdvbTt7cYU2wvGUYzuYLOnJy7UYvHa/sodfuMEjoxg/5oHj13Q=="}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:11.276452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-5f14bba0-cb42-425e-9d4c-1a02d435efeb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Getting quotas for project a375619d804c4675a5b9115aa13759a8. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:14:11.280705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-5f14bba0-cb42-425e-9d4c-1a02d435efeb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Getting quotas for user 7a851cc02ef54ebc9101964bb5c0d9d7 and project a375619d804c4675a5b9115aa13759a8. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:14:11.414821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5f14bba0-cb42-425e-9d4c-1a02d435efeb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.159197 Aug 06 22:14:11.415558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 223/447] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:14:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:14:11.468876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-786317925", "imageRef": "d076fde4-820a-4aa7-92ef-3fc7642c72b1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1006183456", "networks": [{"uuid": "b15bbd3b-8943-435f-b834-9534c23cffbf"}]}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:11.519330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] validate_networks() for [('b15bbd3b-8943-435f-b834-9534c23cffbf', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:14:11.730106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-b9f92f7b-891f-4706-98aa-d3e0bb8a6b63 req-7a6b6233-a27d-4f4e-a69b-11c327678102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf8ec91-febf-4f9e-a540-08f48c5baae8", "tag": "a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:11.740103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-b9f92f7b-891f-4706-98aa-d3e0bb8a6b63 req-7a6b6233-a27d-4f4e-a69b-11c327678102 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:11.747171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-b9f92f7b-891f-4706-98aa-d3e0bb8a6b63 req-7a6b6233-a27d-4f4e-a69b-11c327678102 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:11.747171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-b9f92f7b-891f-4706-98aa-d3e0bb8a6b63 req-7a6b6233-a27d-4f4e-a69b-11c327678102 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:11.751893 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-b9f92f7b-891f-4706-98aa-d3e0bb8a6b63 req-7a6b6233-a27d-4f4e-a69b-11c327678102 service nova] Creating event network-changed:a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e for instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 on hv-cinder-84984 Aug 06 22:14:11.756910 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-b9f92f7b-891f-4706-98aa-d3e0bb8a6b63 req-7a6b6233-a27d-4f4e-a69b-11c327678102 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031560 Aug 06 22:14:11.757527 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 224/448] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:14:11.833817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:11.834693 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:11.841876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:11.842362 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:11.843363 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:11.844268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:11.844863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:11.845294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:11.954336 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:14:11.954833 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:14:11.955228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:14:11.955636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:14:11.956099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:14:11.966752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:11.967241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:11.967837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:11.968636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:11.969093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:11.969519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:11.989651 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Getting quotas for project a375619d804c4675a5b9115aa13759a8. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:14:11.994235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Getting quotas for user 7a851cc02ef54ebc9101964bb5c0d9d7 and project a375619d804c4675a5b9115aa13759a8. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:14:12.003958 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:12.006395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:14:12.009599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d076fde4-820a-4aa7-92ef-3fc7642c72b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:14:12.013974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2ffe8dc5-a7c0-4cee-8e5d-8a567a0c5bda tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.184203 Aug 06 22:14:12.015022 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 225/449] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:11 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:12.136459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6e588617-1107-4dba-a0aa-8d8e76cc4a28 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673845 Aug 06 22:14:12.137660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 225/450] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:14:12.154990 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ac9ffe91-9e2c-41b7-8e37-d30b29004770 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:12.155642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ac9ffe91-9e2c-41b7-8e37-d30b29004770 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:12.231276 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ac9ffe91-9e2c-41b7-8e37-d30b29004770 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:12.238526 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ac9ffe91-9e2c-41b7-8e37-d30b29004770 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1258 microversion: 2.1 time: 0.094567 Aug 06 22:14:12.239118 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 226/451] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:12 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:12.678449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:12.679447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:12.686997 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:12.687482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:12.689290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:12.689290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:12.689290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:12.690246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:12.713492 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-dd047d56-479f-4319-981c-59bae3ef07a8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/ips" status: 200 len: 153 microversion: 2.20 time: 0.039674 Aug 06 22:14:12.714058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 226/452] 10.222.0.18 () {60 vars in 1289 bytes} [Sat Aug 6 22:14:12 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:14:13.035424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:13.036028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:13.042144 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:13.042619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:13.043044 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:13.043721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:13.044168 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:13.044625 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:13.176728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:13.193098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-867fbf77-d94f-48ba-9ebd-d0a9d5884c76 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.161401 Aug 06 22:14:13.194025 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 227/453] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:13 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:13.259757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-aaaa71a9-ddb6-4078-a55b-a3d9977d545f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:13.260574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-aaaa71a9-ddb6-4078-a55b-a3d9977d545f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:13.314966 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aaaa71a9-ddb6-4078-a55b-a3d9977d545f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:13.322686 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-aaaa71a9-ddb6-4078-a55b-a3d9977d545f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1258 microversion: 2.1 time: 0.067522 Aug 06 22:14:13.325876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 227/454] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:13 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:13.714497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1735440815", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "networks": [{"uuid": "f2844852-f7dd-4a0c-bd33-cc6777d6e26c"}]}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:13.772193 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] validate_networks() for [('f2844852-f7dd-4a0c-bd33-cc6777d6e26c', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:14:14.123728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:14:14.124308 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:14:14.124652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:14:14.125055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:14:14.125464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:14:14.134129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:14.134601 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:14.135026 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:14.135735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:14.136180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:14.136633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:14.152713 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Getting quotas for project dc2fb805386743d1a4bfd3b15bde695c. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:14:14.156638 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Getting quotas for user 56138f43f00e46ea9dda399a0fb0e822 and project dc2fb805386743d1a4bfd3b15bde695c. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:14:14.167781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:14:14.170045 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:14:14.215494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:14.216142 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:14.222731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:14.223205 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:14.223724 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:14.224424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:14.225285 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:14.225727 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:14.283809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6cf02313-cabf-43e4-980b-d84d6ee97f2c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573205 Aug 06 22:14:14.284488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 228/455] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:14:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:14:14.297651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7d398425-d412-492d-9215-0abd6540c8c3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:14.298266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7d398425-d412-492d-9215-0abd6540c8c3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:14.301348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:14.371820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7d398425-d412-492d-9215-0abd6540c8c3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:14.381363 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7d398425-d412-492d-9215-0abd6540c8c3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1219 microversion: 2.1 time: 0.086929 Aug 06 22:14:14.382190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 229/456] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:14 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:14.388154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:14.388979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:14.396799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:14.398389 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:14.398925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:14.399829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:14.400499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:14.401369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:14.421465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:14.431497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-87123419-e73d-4ca0-aa5a-68c2c9d339a4 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.219753 Aug 06 22:14:14.432215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:14 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:14.472283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:14.480803 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e0d0810e-f044-41af-9c13-b81754331487 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1254 microversion: 2.1 time: 0.097360 Aug 06 22:14:14.481388 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 230/458] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:14 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1254 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:15.404464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:15.405099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:15.411556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:15.412026 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:15.412481 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:15.413161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:15.415636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:15.415636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:15.452801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:15.453482 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:15.459601 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:15.460446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:15.461211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:15.462139 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:15.462804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:15.467510 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:15.483901 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:15.512634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1fa8dc47-4a04-4414-ada3-1be1bca6be5a tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1223 microversion: 2.1 time: 0.111845 Aug 06 22:14:15.513962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 229/459] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:15 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:15.519204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:15.519988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:15.526113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:15.526820 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:15.527413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:15.528280 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:15.529019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:15.529593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:15.611077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:15.619196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3030e684-0dd9-4d9d-ad5d-db73fe568920 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1254 microversion: 2.1 time: 0.104010 Aug 06 22:14:15.624157 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 230/460] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:15 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1254 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:15.663603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:15.667051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1a935d35-9a1d-4008-bdb3-7bc7f590a2bc tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.218050 Aug 06 22:14:15.667705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 231/461] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:15 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:16.491001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:16.491630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:16.498702 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:16.499178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:16.499608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:16.500283 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:16.500760 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:16.501176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:16.523993 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lazy-loading 'flavor' on Instance uuid 209d7c8e-59b6-4313-a518-a2c8c7eeb290 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:14:16.533385 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:16.535025 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:16.541264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:16.541750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:16.542176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:16.542857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:16.543306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:16.543719 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:16.559029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:16.606856 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:16.614767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-41c1c269-d7a3-405c-8871-003ccb95fd78 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1271 microversion: 2.1 time: 0.085388 Aug 06 22:14:16.615326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 232/462] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:16 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:16.644379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:16.645009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:16.651383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:16.651862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:16.652291 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:16.653031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:16.653469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:16.653891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:16.714299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:16.721673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-60710574-a130-407e-8d00-f2a61f372820 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1310 microversion: 2.1 time: 0.081044 Aug 06 22:14:16.722424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 233/463] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:16 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:16.727402 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:16.728003 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:16.733763 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:16.734246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:16.734679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:16.735368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:16.735823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:16.736254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:16.749661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:16.867304 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:16.874864 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-58510899-8967-451f-999e-077f0351176c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.151597 Aug 06 22:14:16.875422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 234/464] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:16 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:17.058945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a3bd529e-6dcc-415b-9059-1d8488e16c0b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/action" status: 202 len: 0 microversion: 2.20 time: 0.571798 Aug 06 22:14:17.059537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 231/465] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Aug 6 22:14:16 2022] POST /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:14:17.067652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:17.068522 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:17.077135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:17.077135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:17.077135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:17.077135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:17.077475 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:17.077475 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:17.205464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:17.214172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:17.215655 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:17.216823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9cac207b-e4c0-4fcc-b97c-01f5b96dae15 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.152964 Aug 06 22:14:17.217371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 235/466] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:17 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:17.637928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:17.638614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:17.645612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:17.646090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:17.646522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:17.647205 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:17.647649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:17.648269 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:17.709450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:17.716960 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6a3aac87-b1e4-4dac-b84d-5ab8ce14e632 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1271 microversion: 2.1 time: 0.084480 Aug 06 22:14:17.717521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 232/467] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:17 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:17.743862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:17.744493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:17.750919 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:17.751406 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:17.751831 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:17.752539 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:17.752985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:17.753466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:17.817911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:17.825903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e8cbbaa4-ba96-4ab0-8e2d-f1b43dead094 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1310 microversion: 2.1 time: 0.086626 Aug 06 22:14:17.826457 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 236/468] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:17 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:17.895809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:17.896353 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:17.902587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:17.903062 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:17.903490 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:17.904171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:17.904644 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:17.905060 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:18.032168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:18.040039 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7b0b3530-76a2-441f-bef4-c3bff923735f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.148295 Aug 06 22:14:18.040624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 233/469] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:17 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:18.240237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:18.240875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:18.248249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:18.248760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:18.249190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:18.249872 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:18.250319 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:18.250739 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:18.380250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:18.388490 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:18.389997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:18.391149 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-16a7cad1-89f7-485d-8004-1d6f8ca62fc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.154886 Aug 06 22:14:18.391694 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 237/470] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:18 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:18.738338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:18.738960 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:18.745142 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:18.750826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:18.750826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:18.750826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:18.750826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:18.751166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:18.808351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:18.815649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f5fe0821-e6b5-44f1-b294-1ee68cf04015 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1271 microversion: 2.1 time: 0.081613 Aug 06 22:14:18.816208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 234/471] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:18 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:18.846324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:18.846935 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:18.854075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:18.854557 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:18.854993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:18.855679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:18.856134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:18.856599 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:18.916694 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:18.923850 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9fdfc587-bace-40ee-88ee-c884f16cc3ca tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1310 microversion: 2.1 time: 0.081354 Aug 06 22:14:18.924417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 238/472] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:18 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:19.061199 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:19.061808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:19.067632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:19.068107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:19.068576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:19.069290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:19.070435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:19.070860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:19.202176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:19.209551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-28ff6b14-a2fe-43c2-9109-fb9f4cd0f916 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.152274 Aug 06 22:14:19.210139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 235/473] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:19 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:19.415724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:19.416329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:19.422312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:19.422792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:19.423224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:19.423903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:19.424351 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:19.424796 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:19.551527 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:19.560089 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:19.561619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:19.562763 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e5f3b7b9-8aaa-4101-869d-6b56cd206b2e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.151777 Aug 06 22:14:19.563316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 239/474] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:19 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:19.838035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:19.838662 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:19.845045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:19.845516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:19.845940 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:19.846646 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:19.847091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:19.847504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:19.911085 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:19.919544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a6c6c31d-8f39-4301-bab7-516f42f1f707 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1271 microversion: 2.1 time: 0.086332 Aug 06 22:14:19.920099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 236/475] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:19 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:19.944577 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:19.945182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:19.952198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:19.952710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:19.953135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:19.953860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:19.954306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:19.954723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:20.020484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:20.027958 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2c4b01d9-cb7c-43fd-bae9-76d8faff2fee tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1310 microversion: 2.1 time: 0.087252 Aug 06 22:14:20.028548 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 240/476] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:19 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:20.231408 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:20.232010 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:20.238005 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:20.238502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:20.238928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:20.239604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:20.240049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:20.240499 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:20.370349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:20.377679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ecce1352-79ab-4ae9-80ee-b38772099308 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.150050 Aug 06 22:14:20.378236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 237/477] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:20 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:20.585925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:20.586684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:20.592680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:20.593159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:20.593587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:20.594263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:20.594710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:20.595128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:20.721944 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:20.730720 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:20.732220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:20.733405 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c6a17e56-df87-4380-8008-4aa278673d3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.152073 Aug 06 22:14:20.733955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 241/478] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:20 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:20.940538 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:20.941102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:20.947990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:20.948490 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:20.948921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:20.949599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:20.950046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:20.950460 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:21.010268 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:21.017518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2c6effe6-0c45-46bd-963f-e27ca9eb9bb0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1271 microversion: 2.1 time: 0.080962 Aug 06 22:14:21.018073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 238/479] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:20 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:21.048103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:21.048743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:21.055105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:21.055585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:21.056008 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:21.056716 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:21.057161 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:21.057572 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:21.120191 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:21.127485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-83b082c9-aa51-4a97-b5c3-ac3dd48ef073 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1310 microversion: 2.1 time: 0.083154 Aug 06 22:14:21.128036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 242/480] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:21 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:21.398573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:21.399249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:21.405320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:21.410542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:21.410542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:21.410542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:21.410542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:21.410913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:21.539245 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:21.546677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e16a5301-fe87-4dc1-9dc3-adb6dab03e98 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1522 microversion: 2.1 time: 0.152125 Aug 06 22:14:21.547247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 239/481] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:21 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:21.755993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:21.756630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:21.762735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:21.763213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:21.763644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:21.764329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:21.764802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:21.765223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:21.900698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:21.908550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:21.910074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:21.911372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-740c08c2-dd91-4915-a80d-e900ebd6d9be tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.159381 Aug 06 22:14:21.911920 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 243/482] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:21 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:22.040368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:22.040967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:22.043339 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:22.048671 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.049152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.049580 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.050320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.050763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.051181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.113287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:22.120724 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-97db5917-8371-4cdd-96a9-b4ddf1661cd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1271 microversion: 2.1 time: 0.085882 Aug 06 22:14:22.121290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 240/483] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:22 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:22.147394 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:22.148756 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:22.155351 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.155835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.156266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.157046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.157497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.157916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.219054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:22.227799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bec00b63-fa07-45b9-817f-c171f94593c0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1318 microversion: 2.1 time: 0.084163 Aug 06 22:14:22.228388 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 244/484] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:22 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1318 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:22.567042 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:22.567566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:22.574093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.574570 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.574998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.575676 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.576134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.576576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.704723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:22.713304 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-978d24a4-e9d7-4c67-9aca-1e11247e6f01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1502 microversion: 2.1 time: 0.150146 Aug 06 22:14:22.713870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 241/485] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:22 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:22.733409 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:22.734019 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:22.739909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.740390 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.740861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.742090 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.742550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.749623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.877811 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:22.886667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-15324cb5-19d0-430d-8131-3fd721af1dc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1515 microversion: 2.1 time: 0.156958 Aug 06 22:14:22.887687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 245/486] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:22 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:22.936179 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:22.937138 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:22.945793 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.946371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.946816 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:22.947519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:22.947976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:22.948396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:23.106207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:23.116912 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:23.118983 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:23.120169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ec60fa1a-5c03-47f3-881a-63aa52b26a8f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.188888 Aug 06 22:14:23.120945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 242/487] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:22 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:23.141543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:23.142160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:23.148575 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:23.157223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:23.157223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:23.157223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:23.157223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:23.157764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:23.224589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:23.234320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b39bf6d5-6599-498f-a826-10569b0fbc29 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1279 microversion: 2.1 time: 0.096673 Aug 06 22:14:23.234903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 246/488] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:23 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1279 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:23.255816 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:23.256498 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:23.262956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:23.263437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:23.263863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:23.264595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:23.265044 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:23.265471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:23.319153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=8 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:23.347859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:23.358255 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-160cae0e-a197-4c1f-9c7e-333eafef5e87 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1316 microversion: 2.1 time: 0.105731 Aug 06 22:14:23.359844 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 243/489] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:23 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:24.147567 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:24.148825 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:24.150946 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:24.157022 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:24.158014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:24.158574 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:24.159407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:24.160106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:24.160668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:24.270474 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:24.271635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:24.279324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:24.280053 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:24.280665 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:24.281548 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:24.282157 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:24.282729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:24.312111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:24.321418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:24.324458 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:24.325845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0ed076e3-b154-4ca6-bcf9-2e132f74cafa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.186777 Aug 06 22:14:24.326527 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 247/490] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:24 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:24.388296 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:24.389766 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:24.391794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=14 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:24.397673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:24.398443 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:24.398996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:24.399820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:24.400283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:24.400737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:24.428216 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:24.437146 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-99c14b08-aa0e-4095-9f7d-53c8c9560f8e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.170718 Aug 06 22:14:24.437892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 244/491] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:24 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:24.542128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:24.550467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8180b7c4-7967-474e-9145-eef7f3abf604 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.168873 Aug 06 22:14:24.559556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 248/492] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:24 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:25.348770 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:25.349378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:25.357198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:25.357697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:25.358129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:25.358837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:25.359290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:25.359706 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:25.459570 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:25.460977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:25.468261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:25.468807 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:25.469201 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:25.469896 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:25.470343 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:25.470758 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:25.490114 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:25.507562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:25.513964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:25.515460 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:25.516637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ae03cadb-8d62-46dc-b193-e5070c1ec660 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.171853 Aug 06 22:14:25.517186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 245/493] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:25 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:25.571544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:25.572158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:25.583150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:25.583709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:25.584246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:25.585691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:25.588453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:25.588910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:25.645312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:25.653946 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a5f59fd6-94b8-41bc-9455-88d74d5e69e1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.198693 Aug 06 22:14:25.667868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 249/494] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:25 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:25.733603 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:25.741021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-700ee0d5-a432-4123-81f2-357a12183818 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.173872 Aug 06 22:14:25.742305 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 246/495] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:25 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:26.542240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:26.542778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:26.549359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:26.549841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:26.550273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:26.550972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:26.551422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:26.551907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:26.675038 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:26.675910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:26.683707 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:26.684609 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:26.685295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:26.686437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:26.687098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:26.687694 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:26.693072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:26.701970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:26.703460 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:26.704638 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-df6a864b-7e2c-4a99-9cf4-b8904ec92722 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.166997 Aug 06 22:14:26.705469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 250/496] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:26 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:26.767060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:26.767800 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:26.774162 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:26.774499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:26.774931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:26.775659 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:26.776135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:26.776587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:26.854800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:26.862050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-70e537cc-185e-4eed-900f-e1187e8084b1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.190907 Aug 06 22:14:26.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 247/497] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:26 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:26.926798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:26.935107 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e8e1cc13-f361-489b-9d64-05605dc3e590 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.171914 Aug 06 22:14:26.935667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 251/498] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:26 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:27.043610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:27.045944 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:27.052380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.052888 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.053386 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.054769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.055402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.055900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.060126 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:27.079365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lazy-loading 'flavor' on Instance uuid c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:14:27.359629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f7736c2b-f7b8-47bb-962b-fa449d6645d7 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9/action" status: 200 len: 32 microversion: 2.1 time: 0.319978 Aug 06 22:14:27.360231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 248/499] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:14:27 2022] POST /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:14:27.369919 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:27.370529 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:27.376717 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.377208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.377641 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.378426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.378885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.379305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.511951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:27.519731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0674c4aa-4f98-4603-b27a-f6829032982c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.153880 Aug 06 22:14:27.520293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 252/500] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:27 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:27.730974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:27.731671 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:27.737964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.738453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.738887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.739578 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.740027 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.740480 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.870945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:27.881072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:27.884608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:27.884772 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:27.884772 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:27.885350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-43f28688-2cf1-444e-b4b4-9c62ef8a10fd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.158241 Aug 06 22:14:27.885350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 249/501] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:27 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:27.891402 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.891886 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.892315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.893030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.893483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.893899 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.955232 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:27.955847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:27.963334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.963843 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.964284 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:27.965661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:27.966134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:27.966564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:28.071297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:28.078988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3e193667-a1cf-4769-8c6b-cef1366905e4 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.199611 Aug 06 22:14:28.079679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 253/502] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:27 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:28.135071 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:28.142657 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5f2777a9-c4bd-4fd7-a7d3-0e1f57f5af47 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.191196 Aug 06 22:14:28.143225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 250/503] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:27 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:28.542471 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:28.543123 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:28.549597 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:28.550094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:28.550533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:28.551266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:28.551724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:28.552148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:28.695422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:28.698161 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-00958fbf-704f-4b45-a40d-ba6a08f16213 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.160652 Aug 06 22:14:28.698954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 254/504] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:28 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:28.909512 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:28.910261 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:28.923531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:28.924020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:28.924509 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:28.925225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:28.925704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:28.926129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:29.059450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:29.067752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:29.069341 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:29.070492 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6c9f43b4-695b-40ed-ba43-61402a279519 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.164873 Aug 06 22:14:29.071046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 251/505] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:28 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:29.101450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:29.102066 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:29.109182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:29.109665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:29.110097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:29.110793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:29.111356 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:29.111663 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:29.164122 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:29.164753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:29.170844 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:29.171317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:29.171744 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:29.172484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:29.172939 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:29.173353 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:29.319150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:29.326776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4682662e-2f3c-46fb-8cdf-bbbbb15529c0 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.230152 Aug 06 22:14:29.327357 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 255/506] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:29 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:29.352959 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:29.365066 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8bd69aa8-0614-4c78-b7cd-99b0d61fd8ec tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.204785 Aug 06 22:14:29.365791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 252/507] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:29 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:29.719099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:29.719715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:29.726754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:29.727237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:29.727664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:29.728346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:29.728826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:29.729247 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:29.892361 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:29.907257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-59bb2cc1-d00b-4afb-b60d-9235467d58ea tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.191869 Aug 06 22:14:29.907839 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 256/508] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:29 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:30.093863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:30.094473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:30.102004 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:30.102490 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:30.102927 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:30.103627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:30.104080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:30.104538 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:30.252598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:30.261810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:30.263316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:30.264504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1187bb25-02c5-4a0e-8c78-d1fabfc8e20d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.174565 Aug 06 22:14:30.265059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 253/509] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:30 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:30.348498 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:30.350382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:30.357953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:30.358743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:30.359423 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:30.360501 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:30.361160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:30.361783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:30.389028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:30.389787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:30.396467 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:30.397032 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:30.397777 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:30.399190 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:30.418613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:30.418613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:30.614322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:30.621899 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:30.624392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ffc1bc7b-48c9-4f4f-af23-c3552b1b9dea tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.239115 Aug 06 22:14:30.625491 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 254/510] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:30 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:30.643760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0326f500-c9bc-4201-8f68-ec549eea9c79 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.299252 Aug 06 22:14:30.645001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 257/511] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:30 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:30.928466 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:30.929311 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:30.936686 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:30.937562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:30.938364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:30.939322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:30.939929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:30.940555 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.289113 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:31.289757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:31.295635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:31.296198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:31.296198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:31.296667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.297368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:31.297874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:31.298303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.304153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b1dff931-2814-42ac-95b7-033c2d11c288 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.379329 Aug 06 22:14:31.304823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 255/512] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:30 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:31.447499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:31.455386 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:31.456901 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:31.458048 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8390fddf-e009-4e05-9c74-260423311cd7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.173146 Aug 06 22:14:31.458593 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 258/513] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:31 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:31.646206 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:31.646872 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:31.654395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:31.655151 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:31.655775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.656679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:31.657282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:31.657888 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.665538 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:31.666244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:31.672723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:31.673200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:31.673630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.674382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:31.674829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:31.675247 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.882419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:31.887246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:31.890104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cc8b20e5-9937-428a-8979-a4645a2dc502 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.247804 Aug 06 22:14:31.890632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 256/514] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:31 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:31.894979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-05938146-88d0-401e-b6be-b530e3626666 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.233835 Aug 06 22:14:31.895572 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 259/515] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:31 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:31.905338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:31.905835 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:31.912093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:31.913476 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:31.914370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.915171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:31.915678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:31.916324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:31.941835 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f1217f9e-a8f9-4c42-92c0-bdbc46032d97 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/ips" status: 200 len: 149 microversion: 2.1 time: 0.040280 Aug 06 22:14:31.942739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 257/516] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:14:31 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:14:32.326476 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:32.326999 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:32.333215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:32.334305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:32.334305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:32.335005 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:32.335615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:32.336065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:32.495301 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:32.495979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:32.495979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:32.496679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9238a9f6-c5d7-4465-961d-6346f05971f5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.163071 Aug 06 22:14:32.496679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 260/517] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:32 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:32.496868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:32.496868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:32.496868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:32.496868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:32.497197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:32.497197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:32.660370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:32.671405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:32.672928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:32.674151 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-aec69e09-d591-47c8-a2bc-b9e1e72fbe3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.195550 Aug 06 22:14:32.674714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 258/518] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:32 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:32.911174 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:32.912144 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:32.916035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:32.916690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:32.919043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:32.919704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:32.920231 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:32.921041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:32.921709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:32.922334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:32.922741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:32.923217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:32.923642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:32.924703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:32.925150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:32.925740 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:33.142894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:33.154613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fe85dae2-91ba-46b5-aa90-eeac0da110c5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.247373 Aug 06 22:14:33.155194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:33.169653 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 261/519] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:32 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:33.172373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a9c86fc0-5259-4a6a-bb8e-7452e996a1a6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.259987 Aug 06 22:14:33.173553 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 259/520] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:32 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:33.508732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:33.509333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:33.516060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:33.516596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:33.517697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:33.517697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:33.518200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:33.518617 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:33.666534 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:33.682977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3f679cc3-498d-44fb-bc61-84d0af8c16e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.170426 Aug 06 22:14:33.682977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 262/521] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:33 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:33.696955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:33.697590 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:33.704008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:33.704531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:33.704962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:33.705649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:33.706099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:33.706522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:33.847124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:33.856701 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:33.858339 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:33.859564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-707b17fd-2508-4ee1-b208-e52795ca4f83 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.166531 Aug 06 22:14:33.860114 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 260/522] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:33 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:34.177684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:34.179056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:34.185009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:34.185701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:34.186103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:34.186786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:34.187263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:34.187684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:34.193824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:34.195028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:34.204021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:34.209629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:34.210439 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:34.213196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:34.213791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:34.215724 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:34.421903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:34.430074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c2f38b21-9fcf-412d-8b15-82cb36111749 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.256100 Aug 06 22:14:34.430236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:34.430551 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 263/523] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:34 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:34.438481 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fd945ebd-cf5e-4708-ad98-4d4c40542b98 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.248708 Aug 06 22:14:34.441500 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 261/524] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:34 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:34.827626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:34.827626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:34.827626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:34.827626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:34.829222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:34.829222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:34.829222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:34.829222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:34.855814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:34.863298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8475a022-3f09-4902-b3ac-483147744a7a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.164059 Aug 06 22:14:34.863874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 264/525] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:34 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:34.883485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:34.884088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:34.891067 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:34.891552 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:34.892186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:34.893073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:34.893676 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:34.894244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:35.039834 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:35.053070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:35.055192 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:35.056420 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-61dcb4cc-f06d-427f-a3dc-03eab7f201c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.177151 Aug 06 22:14:35.056991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 262/526] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:34 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:35.337771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:35.340184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:35.346575 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:35.347312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:35.348085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:35.349081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:35.349979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:35.350583 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:35.429882 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:35.453389 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:35.454115 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:35.464025 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:35.464615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:35.465052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:35.465808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:35.466254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:35.466672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:35.471285 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:35.651730 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:35.665197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-eac42a5c-72e2-4d0b-b64e-689110b592fd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.216145 Aug 06 22:14:35.665964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 263/527] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:35 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:35.670423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:35.671027 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:35.677661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:35.678221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:35.678645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:35.679337 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:35.679787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:35.680201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:35.820836 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:35.828337 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-239221de-1280-475a-bca4-0be5a783a024 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.161518 Aug 06 22:14:35.957841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 264/528] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:35 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:35.957841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:35.957841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:35.957841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:35.957841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:35.958801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:35.958801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:35.958801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:35.958801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:35.959160 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:36.033061 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:36.040622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-09ef9549-d4e1-405e-9a51-06be2081820c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.159101 Aug 06 22:14:36.041195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 265/529] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:35 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:36.079841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:36.080365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:36.087585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:36.088064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:36.088539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:36.089282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:36.089721 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:36.090141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:36.217775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:36.225964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:36.227461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:36.228661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6a0b507f-0ee8-4280-a5df-e1eb7ab6bfd5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.152751 Aug 06 22:14:36.229217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 266/530] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:36 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:36.686319 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:36.686979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:36.692968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:36.693447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:36.693918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:36.694600 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:36.695049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:36.695468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:36.827865 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:36.835405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-57a471bf-052a-43f5-850c-4509dca942e4 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.153416 Aug 06 22:14:36.835955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 267/531] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:36 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:36.978219 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:36.978881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:36.985203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:36.985684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:36.986117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:36.986803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:36.987298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:36.987718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:37.116051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:37.123484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6b1a1356-6367-4bd2-9b70-479e17869c3f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.149477 Aug 06 22:14:37.124041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 268/532] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:36 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:37.128389 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:37.129004 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:37.135505 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:37.135979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:37.136481 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:37.139222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:37.139222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:37.139222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:37.267215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:37.274664 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0f9d9b06-80b6-44e2-8684-075f91831d2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.149672 Aug 06 22:14:37.275225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 269/533] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:37 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:37.279543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:37.280138 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:37.285659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:37.286141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:37.286564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:37.287246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:37.287695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:37.288118 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:37.419761 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:37.427604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:37.429752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:37.430896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3785de0e-9ca3-41e3-962c-41eaa3cf71a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.154774 Aug 06 22:14:37.431455 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 270/534] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:37 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:37.857873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:37.858353 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:37.864698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:37.865189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:37.865815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:37.866802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:37.867328 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:37.867764 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:38.003443 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:38.011887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7e49b94b-b602-452c-864c-8221878e3eb5 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.158708 Aug 06 22:14:38.012537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 271/535] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:37 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:38.145181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:38.145717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:38.151937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:38.152490 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:38.152920 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:38.153605 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:38.154049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:38.154465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:38.284928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:38.293002 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5bb1055c-4c3c-482c-ada1-65f6012d2766 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.151749 Aug 06 22:14:38.293556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 272/536] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:38 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:38.297819 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:38.298408 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:38.304630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:38.305109 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:38.305536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:38.306212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:38.306658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:38.307075 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:38.434882 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:38.442526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-69504eb3-8b46-4d69-a3a1-8142fbd27b3f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.148010 Aug 06 22:14:38.443130 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 273/537] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:38 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:38.452937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:38.453559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:38.459168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:38.459664 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:38.460184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:38.460896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:38.461351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:38.461774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:38.592767 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:38.601891 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:38.603410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:38.604602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d14e9608-b5ca-444f-832d-74a31f9f6024 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.155134 Aug 06 22:14:38.605158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 274/538] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:38 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:39.033097 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:39.033743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:39.040299 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:39.040804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:39.041234 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:39.041912 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:39.042357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:39.042776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:39.170101 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:39.177442 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-61f64b9a-717f-4d4a-8dae-c1c7f8a2ccfc tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.148218 Aug 06 22:14:39.178039 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 275/539] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:39 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:39.313883 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:39.314423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:39.321045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:39.321522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:39.321948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:39.322619 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:39.323060 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:39.323474 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:39.452170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:39.459534 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5b44a2f0-bc27-4d74-b6eb-a30acc5ab77c tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.149320 Aug 06 22:14:39.460087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 276/540] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:39 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:39.464366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:39.464981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:39.470523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:39.470999 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:39.471430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:39.472110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:39.472580 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:39.472999 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:39.603971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:39.611369 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4f87314b-6914-47b1-b3a5-6cfd2793c88a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.150341 Aug 06 22:14:39.611921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 277/541] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:39 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:39.626683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:39.627273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:39.633082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:39.633554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:39.633981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:39.634653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:39.635105 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:39.635517 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:39.762822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:39.770720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:39.772461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:39.773604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0d2865e5-7dbe-48a4-b154-69b43bd7f85e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.150536 Aug 06 22:14:39.774157 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 278/542] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:39 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:40.197958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:40.198617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:40.204979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:40.205453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:40.205888 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:40.206560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:40.207009 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:40.207423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:40.335799 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:40.339182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:40.343527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ed0b0110-c314-4221-bf12-afc299cb1c3f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.149435 Aug 06 22:14:40.344105 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 279/543] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:40 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:40.480736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:40.481337 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:40.487318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:40.487787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:40.488211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:40.488906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:40.489352 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:40.489766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:40.618909 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:40.626288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-25f83857-b503-43ea-88cf-cbed9dd4e791 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.149755 Aug 06 22:14:40.626842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 280/544] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:40 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:40.632729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:40.633327 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:40.639041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:40.641300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:40.641300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:40.641300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:40.641300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:40.641659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:40.777978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:40.785558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-922cf61a-feca-4060-9631-4548e7a13885 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.156785 Aug 06 22:14:40.786124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 281/545] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:40 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:40.797015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:40.797830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:40.804475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:40.804958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:40.805390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:40.806073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:40.806522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:40.806943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:40.950813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:40.959144 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:40.960866 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:40.962023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8cdf7b20-d9fa-4588-809e-2c971f8cfa91 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.168817 Aug 06 22:14:40.962574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 282/546] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:40 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:41.365369 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:41.366082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:41.373810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:41.374303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:41.374750 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:41.375453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:41.375908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:41.376333 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:41.523745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:41.531576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c726664a-41c3-4830-bfeb-e68fa06cc4a2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.170091 Aug 06 22:14:41.532669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 283/547] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:41 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:41.648087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:41.648878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:41.655228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:41.655746 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:41.656228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:41.656991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:41.657467 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:41.657892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:41.891695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:41.899315 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ffadb8eb-c172-4521-bb46-fff723c164de tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.255299 Aug 06 22:14:41.906026 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 284/548] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:41 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:41.913406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:41.913406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:41.929589 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:41.929775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:41.930141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:41.930951 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:41.931566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:41.931996 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:42.125092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:42.133360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6f071d3f-7af1-4e6c-9d64-1e9978496608 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.226281 Aug 06 22:14:42.136088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 285/549] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:41 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:42.138391 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:42.138985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:42.144595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:42.145070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:42.145499 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:42.146174 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:42.147248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:42.147815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:42.287195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:42.295480 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:42.297016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:42.298167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8b547181-6dc5-43e7-8e4c-26891dcfd101 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.163340 Aug 06 22:14:42.298722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 286/550] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:42 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:42.303705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-af7f009d-31f2-4c9b-b331-4912d29b826f req-1c6d6ae2-5dcd-4118-a0d8-053053034f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74bb920d-a774-46ac-9b12-a2668c3c4c00", "tag": "fc5e00ba-86fd-486f-99b6-958f4f7d5e5f"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:42.313009 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-af7f009d-31f2-4c9b-b331-4912d29b826f req-1c6d6ae2-5dcd-4118-a0d8-053053034f44 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:42.313479 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-af7f009d-31f2-4c9b-b331-4912d29b826f req-1c6d6ae2-5dcd-4118-a0d8-053053034f44 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:42.313947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-af7f009d-31f2-4c9b-b331-4912d29b826f req-1c6d6ae2-5dcd-4118-a0d8-053053034f44 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:42.325240 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-af7f009d-31f2-4c9b-b331-4912d29b826f req-1c6d6ae2-5dcd-4118-a0d8-053053034f44 service nova] Creating event network-changed:fc5e00ba-86fd-486f-99b6-958f4f7d5e5f for instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 on hv-cinder-84984 Aug 06 22:14:42.330368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-af7f009d-31f2-4c9b-b331-4912d29b826f req-1c6d6ae2-5dcd-4118-a0d8-053053034f44 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030570 Aug 06 22:14:42.330929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 287/551] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:14:42.341174 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-45508939-5c9e-4b27-84df-e675c681c29b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.007810 Aug 06 22:14:42.342061 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 265/552] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:14:35 2022] POST /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments => generated 194 bytes in 7009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:14:42.552754 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:42.553554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:42.560363 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:42.560867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:42.561291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:42.561974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:42.562418 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:42.562833 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:42.692394 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:42.701230 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e296c3b5-4d4f-4b49-b9a8-1e39d4defa6b tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.152843 Aug 06 22:14:42.707455 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 288/553] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:42 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:42.921380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:42.922017 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:42.928876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:42.929349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:42.929773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:42.930448 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:42.930890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:42.931306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:43.073312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:43.082343 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-af6de8c9-7d4b-47b1-8e18-1d2f86f1a7e9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.165623 Aug 06 22:14:43.083436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 266/554] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:42 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:43.155045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:43.155655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:43.161614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:43.162096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:43.162848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:43.163551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:43.164016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:43.164473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:43.322834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:43.323441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:43.330408 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:43.330889 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:43.331319 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:43.332012 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:43.332484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:43.332906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:43.368614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:43.376390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f1627ed7-81bb-49c8-8a71-c7f548389644 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.225174 Aug 06 22:14:43.378550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 289/555] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:43 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:43.520265 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:43.525972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:43.527529 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:43.528860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-02021218-469e-44ba-8ef4-0cfd3485e14b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.210596 Aug 06 22:14:43.529533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 267/556] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:43 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:43.722905 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:43.723513 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:43.731635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:43.732235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:43.732988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:43.733800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:43.734365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:43.734894 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:43.919554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:43.926943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-04306a9c-96c8-46ed-b324-6bcec98534df tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.207873 Aug 06 22:14:43.927493 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 290/557] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:43 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:44.107417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:44.108276 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:44.115787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.116276 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.116740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:44.117440 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.117954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.118377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:44.273091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:44.281379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-65e452fc-dd91-4dda-a6ba-f4312d2a7340 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.178078 Aug 06 22:14:44.281955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 268/558] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:44 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:44.347587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-32dab3e7-f2bb-4c05-94a0-096b8356f98d req-390eaab1-bbd5-455b-9493-244fbd14975e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae294de-ba68-4354-a1de-e7ba7571b870", "tag": "cf0a94b0-3677-4694-8913-092e34a6b8cf"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:44.357898 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-32dab3e7-f2bb-4c05-94a0-096b8356f98d req-390eaab1-bbd5-455b-9493-244fbd14975e service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.358317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-32dab3e7-f2bb-4c05-94a0-096b8356f98d req-390eaab1-bbd5-455b-9493-244fbd14975e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.358744 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-32dab3e7-f2bb-4c05-94a0-096b8356f98d req-390eaab1-bbd5-455b-9493-244fbd14975e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:44.370127 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-32dab3e7-f2bb-4c05-94a0-096b8356f98d req-390eaab1-bbd5-455b-9493-244fbd14975e service nova] Creating event network-changed:cf0a94b0-3677-4694-8913-092e34a6b8cf for instance cae294de-ba68-4354-a1de-e7ba7571b870 on hv-cinder-84984 Aug 06 22:14:44.374854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-32dab3e7-f2bb-4c05-94a0-096b8356f98d req-390eaab1-bbd5-455b-9493-244fbd14975e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030948 Aug 06 22:14:44.379090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 291/559] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:14:44.399139 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:44.403332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:44.405683 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.406195 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.406635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:44.407412 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.407870 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.408294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:44.548995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:44.554733 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:44.555892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:44.558681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7cb2cd5a-a266-4c02-a9b0-b40102a8d51c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.164441 Aug 06 22:14:44.559455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 269/560] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:44 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:44.564349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.565094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.565597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:44.566301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.566756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.567876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:44.712367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:44.720372 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:44.722024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:44.723175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cc7a8856-483c-4931-9d2b-661e51b6523d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1744 microversion: 2.20 time: 0.174831 Aug 06 22:14:44.723798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 292/561] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:44 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:44.947433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:44.947995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:44.950031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=84 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:44.954665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.955150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.955576 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:44.956256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:44.956743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:44.957161 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:45.087968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:45.095509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-73253695-4bc7-4d8c-a717-bd75b4fa92bb tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.152002 Aug 06 22:14:45.096068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 270/562] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:44 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:45.302316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:45.302945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:45.309575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:45.310054 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:45.310487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:45.311173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:45.311617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:45.312033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:45.439864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:45.447708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-daf8fcea-b240-4a01-b07b-d38d6393d173 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.149318 Aug 06 22:14:45.448274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 293/563] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:45 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:45.585684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:45.586364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:45.593466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:45.593759 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:45.594380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:45.595101 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:45.595537 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:45.596453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:45.742224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:45.747594 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:45.748323 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:45.750721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-567b352d-1c67-45d2-aa15-2a87d47d028e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.169561 Aug 06 22:14:45.751436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 271/564] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:45 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:45.756506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:45.757146 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:45.757668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:45.758719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:45.759244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:45.759739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:45.897123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:45.905440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:45.907037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:45.908248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-49f8c2bc-411d-4803-bb5f-05839eb0077b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1744 microversion: 2.20 time: 0.165225 Aug 06 22:14:45.908925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 294/565] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:45 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:46.118390 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:46.118922 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:46.124822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:46.125293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:46.125718 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:46.126397 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:46.126840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:46.127254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:46.263682 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:46.271104 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a6fe3ffd-575c-4b30-8e5e-40f5172db353 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.157696 Aug 06 22:14:46.271698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 272/566] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:46 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:46.468496 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:46.469095 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:46.476087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:46.484288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:46.484829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:46.485587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:46.486049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:46.486468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:46.613185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:46.621270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0668a932-9d3d-458e-84bf-37e98cc6cb89 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.156714 Aug 06 22:14:46.621829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 295/567] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:46 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:46.772626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:46.773239 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:46.779511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:46.779992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:46.780458 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:46.781269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:46.781654 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:46.782098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:46.909786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:46.918030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4c3e0fdd-a489-4b98-89ab-0c66f05ac9c1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.149767 Aug 06 22:14:46.918527 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 273/568] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:46 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:46.931196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:46.936511 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:46.937917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:46.938399 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:46.938836 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:46.939524 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:46.939978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:46.940432 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:47.071969 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:47.080718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:47.082211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:47.083352 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9af93090-7191-43e7-92dc-2779003de717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1744 microversion: 2.20 time: 0.156223 Aug 06 22:14:47.084469 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 296/569] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:46 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:47.291296 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:47.292001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:47.297805 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:47.299780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:47.299780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:47.299780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:47.299780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:47.300211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:47.426476 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:47.434093 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-98eb8c50-22bb-449e-9c30-350c1ba52d00 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.146966 Aug 06 22:14:47.434657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 274/570] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:47 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:47.642202 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:47.642875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:47.649843 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:47.650353 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:47.650785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:47.651470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:47.651917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:47.652334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:47.804367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:47.809346 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:47.814345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-377a6e24-7060-4991-be88-11c4a4958359 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.176408 Aug 06 22:14:47.817553 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 297/571] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:47 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:47.890513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-1b7a3aba-b35d-47b1-8780-002216c27a75 req-87fa7ba8-a264-4a7e-887d-8bca97c229d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209d7c8e-59b6-4313-a518-a2c8c7eeb290", "name": "network-vif-plugged", "status": "completed", "tag": "608fc1c7-cd79-4b52-883b-01561aed2ea4"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:47.901445 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-1b7a3aba-b35d-47b1-8780-002216c27a75 req-87fa7ba8-a264-4a7e-887d-8bca97c229d1 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:47.902085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-1b7a3aba-b35d-47b1-8780-002216c27a75 req-87fa7ba8-a264-4a7e-887d-8bca97c229d1 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:47.902546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-1b7a3aba-b35d-47b1-8780-002216c27a75 req-87fa7ba8-a264-4a7e-887d-8bca97c229d1 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:47.914985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-1b7a3aba-b35d-47b1-8780-002216c27a75 req-87fa7ba8-a264-4a7e-887d-8bca97c229d1 service nova] Creating event network-vif-plugged:608fc1c7-cd79-4b52-883b-01561aed2ea4 for instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 on hv-cinder-84984 Aug 06 22:14:47.920247 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-1b7a3aba-b35d-47b1-8780-002216c27a75 req-87fa7ba8-a264-4a7e-887d-8bca97c229d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033758 Aug 06 22:14:47.920877 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 275/572] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:14:47.938389 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:47.939068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:47.945527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:47.946011 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:47.946442 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:47.947316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:47.947761 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:47.948184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:48.091447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:48.103195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-78363e06-a234-4bb9-8732-cf5fce97af01 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.168493 Aug 06 22:14:48.104351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 298/573] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:47 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:48.107522 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:48.108216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:48.114476 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:48.115622 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:48.116746 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:48.117014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:48.117463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:48.118054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:48.258629 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:48.267043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:48.268681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:48.269918 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-911f0a77-4e26-4ec3-9034-a8ef0f70d01e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1744 microversion: 2.20 time: 0.166805 Aug 06 22:14:48.270557 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 276/574] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:48 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:48.455069 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:48.455678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:48.461923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:48.462401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:48.462833 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:48.463516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:48.463973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:48.464390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:48.591379 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:48.598772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0590d663-de41-4eb4-896f-cda492181b3c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.147606 Aug 06 22:14:48.600253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 299/575] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:48 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:48.836521 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:48.837124 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:48.843255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:48.850651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:48.850651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:48.850651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:48.850651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:48.851173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:48.982524 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:48.990401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-91c7211a-7ba2-4dbe-baa6-087d076de59e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.157891 Aug 06 22:14:48.990973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 277/576] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:48 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:49.124452 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:49.125090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:49.131909 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:49.132387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:49.132838 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:49.133580 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:49.134034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:49.134451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:49.298175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:49.298787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:49.307503 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:49.307999 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:49.311273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:49.311273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:49.311273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:49.311929 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:49.316008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:49.324609 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-21831073-9e6d-44da-84dd-701a7607ecf6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.203992 Aug 06 22:14:49.325190 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 300/577] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:49 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:49.622296 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:49.623094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:49.630000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:49.630557 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:49.631117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:49.631831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:49.632282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:49.632737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:49.804905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:49.814849 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:49.816455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:49.820472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-dc23742a-5b09-47e8-8432-a03c308a3582 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1744 microversion: 2.20 time: 0.527926 Aug 06 22:14:49.820472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 278/578] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:49 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1744 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:49.835413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:49.844464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ff088faf-3f32-465a-b7fa-298148354d83 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.226166 Aug 06 22:14:49.845048 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 301/579] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:49 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:50.010671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:50.011424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:50.018278 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:50.018855 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:50.019297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:50.019989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:50.020613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:50.021566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:50.155339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:50.163125 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0d047d25-ef40-4a6f-a2f1-99c5b67afaf9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.156451 Aug 06 22:14:50.163725 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 279/580] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:50 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:50.346226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:50.346836 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:50.354622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:50.354622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:50.354622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:50.354944 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:50.355211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:50.355633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:50.488396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:50.497045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a5606c69-b2c8-474c-b8d6-d14e07917cfb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.154619 Aug 06 22:14:50.497674 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 302/581] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:50 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:50.840671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:50.841269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:50.847058 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:50.847541 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:50.847964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:50.848664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:50.849945 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:50.850367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:50.872523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:50.873125 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:50.878941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:50.879419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:50.879848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:50.881152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:50.881914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:50.882492 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:51.044804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:51.054231 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:51.056053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:51.057247 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6a351fb4-1872-408d-91df-70a3ea9b8b84 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1744 microversion: 2.20 time: 0.220498 Aug 06 22:14:51.058098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 280/582] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:50 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:51.069718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:51.078691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ae3bc964-3d5c-499c-9f76-91a387d52c23 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.210552 Aug 06 22:14:51.079262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 303/583] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:50 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:51.183776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:51.184488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:51.190618 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:51.191265 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:51.191809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:51.192599 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:51.193200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:51.193780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:51.327366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:51.329713 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:51.336232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6459dc6a-d6df-4e32-b3e8-6ffce4e73ae5 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.156354 Aug 06 22:14:51.336837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 281/584] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:51 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:51.518396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:51.518992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:51.525596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:51.526065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:51.526489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:51.527163 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:51.527608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:51.530335 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:51.666462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:51.674194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-35d57e5c-c5dd-4b38-9e1e-4a2936511ade tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.159707 Aug 06 22:14:51.674767 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 304/585] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:51 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:51.956988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-2c8d4c39-5b01-4294-9fa8-8b80336a3a8a req-292cdf6d-940b-417d-b813-cf90a77914a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae294de-ba68-4354-a1de-e7ba7571b870", "name": "network-vif-plugged", "status": "completed", "tag": "cf0a94b0-3677-4694-8913-092e34a6b8cf"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:51.985455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2c8d4c39-5b01-4294-9fa8-8b80336a3a8a req-292cdf6d-940b-417d-b813-cf90a77914a7 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:51.990417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2c8d4c39-5b01-4294-9fa8-8b80336a3a8a req-292cdf6d-940b-417d-b813-cf90a77914a7 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:51.990417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2c8d4c39-5b01-4294-9fa8-8b80336a3a8a req-292cdf6d-940b-417d-b813-cf90a77914a7 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.009697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-2c8d4c39-5b01-4294-9fa8-8b80336a3a8a req-292cdf6d-940b-417d-b813-cf90a77914a7 service nova] Creating event network-vif-plugged:cf0a94b0-3677-4694-8913-092e34a6b8cf for instance cae294de-ba68-4354-a1de-e7ba7571b870 on hv-cinder-84984 Aug 06 22:14:52.022102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-2c8d4c39-5b01-4294-9fa8-8b80336a3a8a req-292cdf6d-940b-417d-b813-cf90a77914a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069221 Aug 06 22:14:52.022825 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 282/586] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:14:52.080595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:52.081648 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:52.089624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:52.090995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:52.091430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.092318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:52.092947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:52.093588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.102679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:52.103163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:52.111117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:52.111675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:52.112068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.112924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:52.113374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:52.114251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.307074 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:52.310377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:52.315098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:52.316828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:52.318089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-117ce945-c7ab-4b19-b146-c88b3476de22 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1744 microversion: 2.20 time: 0.241575 Aug 06 22:14:52.318400 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f1a485a9-6062-4e1e-bdb5-fbb17250ce65 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.222423 Aug 06 22:14:52.318813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 305/587] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:52 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1744 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:52.324871 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 283/588] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:52 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:52.357034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:52.357641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:52.363738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:52.364222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:52.364751 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.365545 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:52.365998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:52.366426 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.507732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:52.515957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cc2f4ac4-5708-4231-b5a6-5d50bc1b4bad tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.162087 Aug 06 22:14:52.516579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 306/589] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:52 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:52.702030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:52.702653 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:52.709260 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:52.709748 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:52.710178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.710860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:52.711335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:52.711757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:52.847782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:52.856216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-63791d93-2469-4764-bf0b-7e226817a586 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.158000 Aug 06 22:14:52.856817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 284/590] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:52 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:53.340038 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:53.340651 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:53.341144 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:53.341823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:53.347228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:53.347713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:53.348096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:53.348229 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:53.348633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:53.348853 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:53.349971 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:53.350445 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:53.350688 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:53.350873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:53.351123 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:53.351545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:53.547701 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:53.555548 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e78f3354-0bc3-47ab-a67a-dc2d0a3df095 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.219862 Aug 06 22:14:53.557149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 307/591] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:53 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:53.560585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:53.561830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:53.562437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:53.568720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:53.569208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:53.569633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:53.569834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:53.570318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:53.570770 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:53.571186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:53.571343 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:53.572528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-665c63b6-1178-4962-b711-e1bf9a5ef8f6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1744 microversion: 2.20 time: 0.235393 Aug 06 22:14:53.573086 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 285/592] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:53 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1744 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:53.701147 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:53.709015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-36b2637d-6af3-4523-9e7d-cc644a96dfc3 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.150291 Aug 06 22:14:53.709577 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 308/593] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:53 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:53.878021 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:53.878812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:53.885979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:53.886384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:53.886814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:53.887502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:53.887948 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:53.888362 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:54.023433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:54.031188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-959573a2-c413-4f11-9f7b-ba8473b11433 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.157392 Aug 06 22:14:54.031844 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 286/594] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:53 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:54.389124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-4305b390-0b32-45ed-9335-fe8e5e46ec4c req-ca3e8ccb-80d8-4058-8619-3fbdd5d900bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bb920d-a774-46ac-9b12-a2668c3c4c00", "name": "network-vif-plugged", "status": "completed", "tag": "fc5e00ba-86fd-486f-99b6-958f4f7d5e5f"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:54.399311 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-4305b390-0b32-45ed-9335-fe8e5e46ec4c req-ca3e8ccb-80d8-4058-8619-3fbdd5d900bc service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:54.399814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-4305b390-0b32-45ed-9335-fe8e5e46ec4c req-ca3e8ccb-80d8-4058-8619-3fbdd5d900bc service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:54.400235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-4305b390-0b32-45ed-9335-fe8e5e46ec4c req-ca3e8ccb-80d8-4058-8619-3fbdd5d900bc service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:54.411591 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-4305b390-0b32-45ed-9335-fe8e5e46ec4c req-ca3e8ccb-80d8-4058-8619-3fbdd5d900bc service nova] Creating event network-vif-plugged:fc5e00ba-86fd-486f-99b6-958f4f7d5e5f for instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 on hv-cinder-84984 Aug 06 22:14:54.417520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-4305b390-0b32-45ed-9335-fe8e5e46ec4c req-ca3e8ccb-80d8-4058-8619-3fbdd5d900bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Aug 06 22:14:54.418977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 309/595] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:14:54.576130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:54.576775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:54.583195 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:54.584062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:54.584526 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:54.585213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:54.585662 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:54.586082 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:54.595741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:54.596593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:54.604327 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:54.604908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:54.605412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:54.606193 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:54.606717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:54.607320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:54.800252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:54.808082 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f280eca9-6182-4320-9b80-f10b2a07ce1c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1358 microversion: 2.1 time: 0.235784 Aug 06 22:14:54.808588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:54.808712 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 287/596] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:54 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:54.813077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:54.813685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:54.816947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:54.818555 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:54.819464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:54.819705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f0bb66cb-e975-4bde-96c6-4d15b6ba81ff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.228336 Aug 06 22:14:54.819948 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:54.820243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 310/597] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:54 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:54.820390 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:54.821090 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:54.821543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:54.821968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:54.960324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:54.967635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3d702521-47c8-4048-a3f5-3046bd53823b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.158033 Aug 06 22:14:54.968188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 288/598] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:54 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:55.052386 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:55.052947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:55.059347 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:55.059830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:55.060345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:55.061292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:55.061906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:55.062785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:55.194407 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:55.201763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a6ed8d5c-a1da-4370-8878-c7461d23f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.153286 Aug 06 22:14:55.203343 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 311/599] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:55 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:55.828905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:55.829514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:55.836301 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:55.836822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:55.837253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:55.837944 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:55.838395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:55.838818 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:55.843253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:55.844119 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:55.851252 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:55.851735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:55.852169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:55.852887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:55.853348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:55.853774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.026719 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.034385 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a23f0335-43ec-498b-bb68-17aca935223e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1548 microversion: 2.1 time: 0.209293 Aug 06 22:14:56.034949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 289/600] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:55 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1548 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:56.039459 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:56.040059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:56.045909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.046236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.046739 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.047504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.047954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.048395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.054546 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.064515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.066065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.067410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6f126200-3080-4115-aa90-b97381b69d38 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.228096 Aug 06 22:14:56.068764 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 312/601] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:55 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:14:56.073265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:56.073886 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:56.079561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.080035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.080592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.081316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.081761 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.082180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.269247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.278670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3f2a73d3-cb32-40d6-bb5e-c4cfe686b9a7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1548 microversion: 2.1 time: 0.208891 Aug 06 22:14:56.279254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 313/602] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:56 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1548 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:56.284103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:56.284854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:56.285070 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.291461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.292013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.292380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.293113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.293833 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.293981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.294671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2bbf826e-048f-4dae-8a1d-b0a6cc4ca8b6 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.258725 Aug 06 22:14:56.295433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 290/603] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:56 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:56.301862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:56.307237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.308207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Searching by: {'deleted': False, 'project_id': 'a375619d804c4675a5b9115aa13759a8'} {{(pid=118456) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 22:14:56.314917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.315392 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.315842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.316586 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.317033 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.317458 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.416836 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.multi_cell_list [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 22:14:56.446148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.453683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7f084ae4-1492-4917-b425-f908f2e1c10b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.173489 Aug 06 22:14:56.454242 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 314/604] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:56 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:56.520499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c0cb540e-cb24-4450-8bbd-d9b8cba4ea14 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223646 Aug 06 22:14:56.521141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 291/605] 10.222.0.18 () {58 vars in 1125 bytes} [Sat Aug 6 22:14:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:14:56.532468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:56.533096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:56.535050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:56.540181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.540702 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.541130 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.543357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:56.543357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:56.543357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:56.546760 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:14:56.671300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:56.679322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-adbc1dea-be17-4a36-aed1-4f98dad30e60 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1548 microversion: 2.1 time: 0.150653 Aug 06 22:14:56.680105 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 315/606] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:56 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:57.091207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:57.091841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:57.098206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:57.098678 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:57.099106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:57.100695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:57.101286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:57.101796 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:57.245288 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:57.258671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:57.260363 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:57.261662 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-aa8a7754-b011-4ad0-939f-d3f107bc3c2f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.174395 Aug 06 22:14:57.262304 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 292/607] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:57 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:57.317308 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:57.318101 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:57.326098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:57.336864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:57.336864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:57.336864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:57.336864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:57.337299 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:57.466839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:57.476031 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-263f98bb-b8a8-4918-a377-46e629968fd9 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.162088 Aug 06 22:14:57.476722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 316/608] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:57 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:57.477154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:57.477814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:57.484093 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:57.484608 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:57.485261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:57.485946 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:57.486392 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:57.486807 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:57.623243 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:57.630686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d604f928-a310-4c8a-a776-b3432468dc72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.158676 Aug 06 22:14:57.631258 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 293/609] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:57 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:58.286555 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:58.287165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:58.294140 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:58.294618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:58.295045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:58.295755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:58.296321 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:58.296772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:58.459510 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:58.469600 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:58.471458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:58.472918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b48374f8-a613-4658-b6b6-7ff5c55536b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.190224 Aug 06 22:14:58.474077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 317/610] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:58 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:58.498504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:58.498504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:58.507159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:58.509071 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:58.509767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:58.510645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:58.511265 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:58.511688 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:58.651373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:58.651924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:58.658001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:58.658743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:58.659351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:58.660349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:58.661003 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:58.661598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:58.730349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:58.744313 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-706eb16a-a6bc-48f4-b401-e4fa8026e32e tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.251397 Aug 06 22:14:58.745605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 294/611] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:58 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:58.835154 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:58.844885 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4c4fb4da-d185-47eb-aa53-a4ec114f5a8d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.197319 Aug 06 22:14:58.845809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 318/612] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:58 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:14:59.497077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:59.497695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:59.504126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:59.504817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:59.505481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:59.506173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:59.506853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:59.507978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:59.642877 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d76332e-274b-4d46-a2bb-8c665450d0b0"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:14:59.645723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:59.657487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:59.658984 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:59.659595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:59.660991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:59.661742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:59.662599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:59.708076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:59.718078 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:59.721335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:59.723880 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d3525645-793e-4f78-a66a-6313d1f3ca26 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.232020 Aug 06 22:14:59.725188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 295/613] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:14:59 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:14:59.770130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:59.771165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:59.778201 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:59.783723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:59.783723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:59.783723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:59.783723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:59.784298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:59.938299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:14:59.947426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-51af6a1a-3b06-463f-a4a0-dae3cc83e154 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1319 microversion: 2.1 time: 0.184317 Aug 06 22:14:59.962497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 296/614] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:59 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:14:59.974230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:14:59.975433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:14:59.984379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:59.985327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:59.985941 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:14:59.986953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:14:59.987558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:14:59.988139 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:00.176295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:00.185742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-511aafba-a8f2-4b5d-83bb-c53b9f6776ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.221830 Aug 06 22:15:00.188130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 297/615] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:14:59 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:00.654373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ec985cbc-f1b6-43e9-8c75-edbd5b55b94e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: .version_select at 0x7f30c6ab9f70>, body: {"keypair": {"name": "tempest-keypair-212183950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkr+mulP6rzgNjSreQ/Lt3axAq9/lrWQeLBDoc3Q9qto1W5neGAuxQd56GfBsFI6FwGH2coEXy5ndQAvI+PFEn6mwmdQsc4Vte5eXrUtg3WUnpi5pABS5EIS7AbGrEp9Q=="}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:00.680955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-ec985cbc-f1b6-43e9-8c75-edbd5b55b94e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for project f4867885fc0d4ca29d2d674465398466. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:15:00.685399 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-ec985cbc-f1b6-43e9-8c75-edbd5b55b94e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for user 0d6e35038fed4b44b986902a5ef55ce8 and project f4867885fc0d4ca29d2d674465398466. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:15:00.897581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ec985cbc-f1b6-43e9-8c75-edbd5b55b94e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.246828 Aug 06 22:15:00.898768 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 298/616] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:15:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:15:00.904520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:00.918612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:00.931614 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:00.932326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:00.932917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:00.933667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:00.934159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:00.934571 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:01.128077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:01.130808 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:01.140139 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:01.141935 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:01.143510 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6b931904-51a7-4601-b7ed-1a0c023c0991 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.243007 Aug 06 22:15:01.143510 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 299/617] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:00 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:01.158249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:01.168966 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:01.178451 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:01.178995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:01.180016 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:01.180756 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:01.187110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:01.187110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:01.338757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:01.346246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-73cbf80b-a34b-4d84-8d7a-23a1db9cddd1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1508 microversion: 2.1 time: 0.201810 Aug 06 22:15:01.352272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 300/618] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:01 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:01.358733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:01.359463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:01.366282 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:01.367336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:01.387514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:01.387514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:01.387514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:01.387514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:01.514651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:01.522865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-eb7aaad2-4fad-42ef-93fd-b8f4318a1166 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.168794 Aug 06 22:15:01.523440 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 301/619] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:01 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:01.536430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5263c354-23a0-4c41-9b07-3f1c5642de03", "device": "/dev/sdb"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:01.536430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:01.536750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:01.537096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:01.537525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:01.538200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:01.539368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:01.539783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:02.353832 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a6e0c647-fbe6-46d8-9fa5-851b2a4d73ba tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "POST /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.709374 Aug 06 22:15:02.356028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 319/620] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:14:59 2022] POST /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments => generated 194 bytes in 2720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:02.377280 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:02.378593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:02.392172 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:02.392689 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:02.393125 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:02.394936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:02.396860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:02.397479 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:02.599450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:02.610721 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:02.615440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:02.617533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3e603f7b-d212-47df-afe4-9f28463cda70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.260069 Aug 06 22:15:02.618355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 320/621] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:02 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:02.624217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:02.624935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:02.633596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:02.637041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:02.637041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:02.637041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:02.638313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:02.639693 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:02.829119 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:02.841023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f8e01e54-7b2a-46ca-bc46-3207fdd2fa82 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1501 microversion: 2.1 time: 0.221431 Aug 06 22:15:02.842705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 321/622] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:02 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:02.868334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "408cd98a-e4e9-4b68-ad16-0181266a5c57"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:02.870751 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:02.877024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:02.877752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:02.879227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:02.879929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:02.880366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:02.880989 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:02.906807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] HTTP exception thrown: Cannot 'attach_volume' instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 while it is in vm_state rescued Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Request method failure captured: Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: POST /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9/os-volume_attachments HTTP/1.1 Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 74 Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7udZGdKqrZM6ePWm1NQTP4djHVVMKMfpH91VVhsbg1Ih5klYx1TuUmO5tg3BHc8qKERiGXBfZq_1iOaksAzWpgvxzeTUsKZRp1JdHqRnblGCGS9K2_2sWw2sp9H7GvzqWWtb2VQtM3RegT0Qiau3QL0y_a3lxZGidgEP423j_l3VubM Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:15:02.909397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_480896a54dab43c8980c8b05c9a793e7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 700f40b4567a4bcdbb2194861f4497d5 Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {"volumeAttachment": {"volumeId": "408cd98a-e4e9-4b68-ad16-0181266a5c57"}} Aug 06 22:15:02.910948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Cannot 'attach_volume' instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 while it is in vm_state rescued Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'server_id': 'c1fe6d06-81d1-46d4-a10a-54fc6d97cea9', 'body': {'volumeAttachment': {'volumeId': '408cd98a-e4e9-4b68-ad16-0181266a5c57'}}} Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:15:02.911978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 while it is in vm_state rescued Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:15:02.914094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:15:02.915691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:15:02.915691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:15:02.915691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 while it is in vm_state rescued Aug 06 22:15:02.915691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:15:02.917365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Returning 409 to user: Cannot 'attach_volume' instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 while it is in vm_state rescued {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:15:02.918814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8a626ce0-5ba7-4b5f-a05b-a59ed576562a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054807 Aug 06 22:15:02.927340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 322/623] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:15:02 2022] POST /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 22:15:02.934031 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:02.934931 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:02.941584 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:02.942310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:02.942921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:02.943625 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:02.944084 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:02.944563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:03.135696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-da4403b7-7ca0-4c8f-8758-2208524ea1a3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9/action" status: 202 len: 0 microversion: 2.1 time: 0.207014 Aug 06 22:15:03.136437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 323/624] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:15:02 2022] POST /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:15:03.145079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:03.145892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:03.154631 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:03.154996 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:03.155431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:03.156314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:03.156836 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:03.157317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:03.430042 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:03.441335 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-06b09c6e-de71-453f-b6bf-d0b229922872 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1509 microversion: 2.1 time: 0.300163 Aug 06 22:15:03.442389 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 324/625] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:03 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:03.642663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:03.643760 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:03.651889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:03.652805 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:03.653573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:03.654472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:03.655139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:03.655773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:03.896492 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:03.907239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:03.909909 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:03.917234 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cf686051-3b50-4997-bcf6-70b65c5f3fc4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.279483 Aug 06 22:15:03.918600 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 325/626] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:03 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:04.006239 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8111dc8e-dcf1-4758-88c7-6bddf022a66f tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "POST /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.481471 Aug 06 22:15:04.008591 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 302/627] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:15:01 2022] POST /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00/os-volume_attachments => generated 194 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:04.466401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:04.467935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:04.474467 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:04.478713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:04.478713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:04.478713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:04.478713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:04.479079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:04.624558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-977238291", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15a3ad5d-cae3-43a4-b19f-06f85bc9b5e1"}], "security_groups": [{"name": "tempest-securitygroup--818230405"}], "key_name": "tempest-keypair-212183950", "user_data": "}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:04.668210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:04.676393 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7d66c4c2-561b-4bf7-adb7-57604d4c71fb tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1509 microversion: 2.1 time: 0.213996 Aug 06 22:15:04.691658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 326/628] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:04 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:04.843218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] validate_networks() for [('15a3ad5d-cae3-43a4-b19f-06f85bc9b5e1', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:15:04.941433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:04.942045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:04.967452 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:04.967933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:04.968366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:04.970197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:04.970651 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:04.971073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:05.245064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:05.245064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:05.245313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:05.245313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f6c19285-e6e9-4b33-9d6a-60ed544e3ecc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.292489 Aug 06 22:15:05.245313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 327/629] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:04 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:15:05.333602 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:15:05.334094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:15:05.334577 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:15:05.335001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:15:05.336199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:15:05.345053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:05.345531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:05.345975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:05.346674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:05.347337 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:05.347821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:05.365761 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for project f4867885fc0d4ca29d2d674465398466. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:15:05.369823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for user 0d6e35038fed4b44b986902a5ef55ce8 and project f4867885fc0d4ca29d2d674465398466. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:15:05.381049 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:15:05.383961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:15:05.631399 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c3df8196-b50f-477f-ab22-2574047502ea tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.011920 Aug 06 22:15:05.634308 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 303/630] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:15:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:15:05.643327 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e6d167a3-6b9c-4869-ab02-a3c7651ece72 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:05.644538 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e6d167a3-6b9c-4869-ab02-a3c7651ece72 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:05.704262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:05.704935 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:05.722396 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:05.722396 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:05.725808 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:05.729230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:05.729721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:05.730159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:05.746847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e6d167a3-6b9c-4869-ab02-a3c7651ece72 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:05.754369 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e6d167a3-6b9c-4869-ab02-a3c7651ece72 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1240 microversion: 2.1 time: 0.114810 Aug 06 22:15:05.763906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 328/631] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:05 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1240 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:05.909038 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:05.917455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-82847de5-e798-4301-850c-302f602893cd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1509 microversion: 2.1 time: 0.221506 Aug 06 22:15:05.918248 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 304/632] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:05 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:06.266127 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:06.266736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:06.274554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:06.275043 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:06.275527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:06.276711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:06.277346 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:06.277776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:06.468016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:06.478745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:06.480734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:06.482164 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f347419f-187b-4702-b92b-d0e5a74412a7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.219960 Aug 06 22:15:06.482841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 329/633] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:06 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:06.778332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:06.780201 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:06.796325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:06.797140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:06.797772 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:06.798686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:06.799172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:06.799702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:06.892293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:06.902522 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-12cc2cf2-684b-4d64-bff6-1583371346d4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1244 microversion: 2.1 time: 0.128778 Aug 06 22:15:06.903911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 305/634] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:06 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1244 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:06.941365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:06.942076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:06.950280 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:06.950843 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:06.951455 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:06.952155 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:06.952695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:06.953127 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:07.131115 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:07.138096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:07.140842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d15a0312-ff64-402d-bd27-3a0122418e99 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1509 microversion: 2.1 time: 0.205653 Aug 06 22:15:07.141978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 330/635] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:06 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:07.509256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:07.509892 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:07.516452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:07.516930 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:07.517371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:07.518295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:07.518738 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:07.519211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:07.668808 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:07.679074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:07.681030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:07.682616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a4a808a4-1810-4582-b17f-9d58da53f158 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.177809 Aug 06 22:15:07.697089 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 306/636] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:07 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:07.925478 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:07.926502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:07.936692 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:07.937505 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:07.938196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:07.939139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:07.939921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:07.940611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:08.017226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:08.027396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e13c2d08-74fd-470b-b917-52473b15b7e5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1236 microversion: 2.1 time: 0.106283 Aug 06 22:15:08.028184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 331/637] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:07 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1236 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:08.167222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:08.167824 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:08.169823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:08.175461 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:08.176034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:08.176552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:08.177488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:08.177953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:08.178474 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:08.334081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:08.343237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-233d6b04-7881-41a1-b94f-0633b019e5a8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1509 microversion: 2.1 time: 0.181206 Aug 06 22:15:08.352615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 307/638] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:08 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:08.707443 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:08.708038 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:08.718717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:08.719228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:08.719655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:08.720331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:08.720810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:08.721223 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:08.848086 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:08.856549 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:08.858044 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:08.859191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e7196506-c19a-4cd3-896f-3df4d0e357ce tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.155962 Aug 06 22:15:08.859740 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 332/639] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:08 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:09.048425 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:09.049072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:09.055471 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:09.055951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:09.056387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:09.057095 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:09.057546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:09.057967 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:09.135953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:09.154677 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-41ef28a0-9d67-4e66-9cba-be8a1bc16d2d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1236 microversion: 2.1 time: 0.109921 Aug 06 22:15:09.156041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 308/640] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:09 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1236 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:09.367307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:09.368028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:09.377697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:09.378270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:09.378775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:09.379554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:09.380072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:09.380607 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:09.568388 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:09.576845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b577358f-697c-403c-810f-b677b49ce8ed tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1515 microversion: 2.1 time: 0.214163 Aug 06 22:15:09.579079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 333/641] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:09 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:09.882371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:09.882925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:09.889305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:09.889801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:09.890232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:09.890904 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:09.891356 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:09.891768 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:10.042550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:10.051128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:10.052699 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:10.054175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d18787c3-afbd-43c8-bf96-40a0df1e8326 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.175532 Aug 06 22:15:10.054747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 309/642] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:09 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:10.183993 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:10.184530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:10.190420 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:10.190895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:10.191347 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:10.192057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:10.192545 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:10.192965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:10.283824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:10.283824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ea1cd09c-4d27-491f-998b-60c22a844e85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1300 microversion: 2.1 time: 0.096926 Aug 06 22:15:10.283824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 334/643] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:10 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:11.077222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:11.077853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:11.084562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:11.085199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:11.085623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:11.086313 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:11.086765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:11.087185 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:11.223045 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:11.232093 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:11.233559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:11.234704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-28d5a83b-72b3-4fd3-9486-2870c17e6a6f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1739 microversion: 2.20 time: 0.161345 Aug 06 22:15:11.235249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 310/644] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:11 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:11.302852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:11.303547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:11.310587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:11.311409 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:11.311927 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:11.312648 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:11.313098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:11.313516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:11.378843 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:11.386133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b2c4cc6e-f8c0-4c2b-959f-ac897ad0c5da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1310 microversion: 2.1 time: 0.087044 Aug 06 22:15:11.386683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 335/645] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:11 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:12.258962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:12.259603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:12.266106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:12.266587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:12.267028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:12.267714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:12.268168 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:12.268628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:12.407171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:12.407907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:12.420939 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:12.422203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:12.423249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:12.425534 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:12.426007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:12.426434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:12.431908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:12.441047 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:12.442813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:12.444249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8fb70cba-bc89-4a07-bb41-ff70ae2a1f56 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1721 microversion: 2.20 time: 0.189863 Aug 06 22:15:12.446379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 311/646] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:12 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:12.459117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b9971c7b-c392-41f7-aa75-f0b5f82ebfde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'create', calling method: .version_select at 0x7f30c6aa3ee0>, body: {"keypair": {"name": "tempest-keypair-600796928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YoNd+czLWPdbckxPaAitWAys94j98Vm8jcp97wcHOv3yrLDg0iTr+gnbaQw9hJOtiDYATXQmifUPQVWYRQBdNr6OoZW3pCOIWb5SzruceznEbu6+r6kVoJXM80DCuuQ=="}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:12.501232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-b9971c7b-c392-41f7-aa75-f0b5f82ebfde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Getting quotas for project 480896a54dab43c8980c8b05c9a793e7. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:15:12.506132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-b9971c7b-c392-41f7-aa75-f0b5f82ebfde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Getting quotas for user 700f40b4567a4bcdbb2194861f4497d5 and project 480896a54dab43c8980c8b05c9a793e7. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:15:12.524625 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:12.534942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-871b66fa-7548-4428-a9dd-be7cb27ed884 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1298 microversion: 2.1 time: 0.132349 Aug 06 22:15:12.536005 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 336/647] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:12 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:12.583977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b9971c7b-c392-41f7-aa75-f0b5f82ebfde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129234 Aug 06 22:15:12.584680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 312/648] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:15:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:13.326946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:13.327842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:13.333789 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:13.334282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:13.334718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:13.336224 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:13.336999 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:13.337470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:13.473525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:13.474408 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:13.486782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:13.487542 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:13.488175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:13.488994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:13.489473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:13.489904 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:13.517244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:13.527584 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-898575f4-9bc5-4067-a88e-e0e1ffd5dee3 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1594 microversion: 2.1 time: 0.204366 Aug 06 22:15:13.528173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 337/649] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:13 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1594 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:13.557780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:13.558539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:13.566831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:13.568198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:13.568198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:13.568738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:13.570437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:13.570902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:13.717874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:13.728207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:13.730233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:13.731826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-beef7364-1101-498d-abde-fb6ec9ae068e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1721 microversion: 2.20 time: 0.264031 Aug 06 22:15:13.732627 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 313/650] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:13 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:15:13.831194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:13.842921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e04f5a41-3742-4f58-acb3-f403c12112df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.288598 Aug 06 22:15:13.842921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 338/651] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:13 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:14.000237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-4a013709-6d95-44f8-9168-a58829219483 req-68f7e9e7-27f4-427f-bc89-9afd67869000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590d6f69-cea6-4299-8686-493f521c1e49", "tag": "a8980de9-10ab-47ce-a5c4-88df8a79362e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:14.010886 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-4a013709-6d95-44f8-9168-a58829219483 req-68f7e9e7-27f4-427f-bc89-9afd67869000 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:14.011352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-4a013709-6d95-44f8-9168-a58829219483 req-68f7e9e7-27f4-427f-bc89-9afd67869000 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:14.011828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-4a013709-6d95-44f8-9168-a58829219483 req-68f7e9e7-27f4-427f-bc89-9afd67869000 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:14.023845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-4a013709-6d95-44f8-9168-a58829219483 req-68f7e9e7-27f4-427f-bc89-9afd67869000 service nova] Creating event network-changed:a8980de9-10ab-47ce-a5c4-88df8a79362e for instance 590d6f69-cea6-4299-8686-493f521c1e49 on hv-cinder-84984 Aug 06 22:15:14.030774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-4a013709-6d95-44f8-9168-a58829219483 req-68f7e9e7-27f4-427f-bc89-9afd67869000 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034357 Aug 06 22:15:14.031680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 314/652] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:14.404910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-d0c2ce07-e7cf-4894-878c-57f7081656ec req-0ce39be8-a6aa-4db4-a79d-f204ead7f95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209d7c8e-59b6-4313-a518-a2c8c7eeb290", "name": "network-vif-unplugged", "status": "completed", "tag": "608fc1c7-cd79-4b52-883b-01561aed2ea4"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:14.414361 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-d0c2ce07-e7cf-4894-878c-57f7081656ec req-0ce39be8-a6aa-4db4-a79d-f204ead7f95a service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:14.415034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-d0c2ce07-e7cf-4894-878c-57f7081656ec req-0ce39be8-a6aa-4db4-a79d-f204ead7f95a service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:14.426708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-d0c2ce07-e7cf-4894-878c-57f7081656ec req-0ce39be8-a6aa-4db4-a79d-f204ead7f95a service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:14.429654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-d0c2ce07-e7cf-4894-878c-57f7081656ec req-0ce39be8-a6aa-4db4-a79d-f204ead7f95a service nova] Creating event network-vif-unplugged:608fc1c7-cd79-4b52-883b-01561aed2ea4 for instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 on hv-cinder-84984 Aug 06 22:15:14.435187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-d0c2ce07-e7cf-4894-878c-57f7081656ec req-0ce39be8-a6aa-4db4-a79d-f204ead7f95a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034065 Aug 06 22:15:14.435924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 339/653] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:14.757333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:14.758546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:14.795218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:14.797687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:14.798393 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:14.799297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:14.799913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:14.800531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:14.863670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:14.864684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:14.874998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:14.876461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:14.877001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:14.878002 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:14.878654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:14.879401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:15.351764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:15.359206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:15.364083 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:15.365657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:15.367326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-40669195-1680-40cf-a15f-0490e681bee3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1721 microversion: 2.20 time: 0.615673 Aug 06 22:15:15.367893 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 315/654] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:14 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1721 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:15.372822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:15.380454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-53c90194-2cae-481b-a6cb-45189c6853a4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.521026 Aug 06 22:15:15.381127 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 340/655] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:14 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:15.427098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-587078581", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc9946af-58f0-44bb-950a-34c53ff0c790"}], "security_groups": [{"name": "tempest-securitygroup--817853403"}], "key_name": "tempest-keypair-600796928", "user_data": "}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:15.574523 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] validate_networks() for [('dc9946af-58f0-44bb-950a-34c53ff0c790', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:15:16.185861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:15:16.186456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:15:16.189508 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:15:16.189508 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:15:16.189508 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:15:16.196905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.197643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.198262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.199141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.199751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.200336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.220879 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Getting quotas for project 480896a54dab43c8980c8b05c9a793e7. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:15:16.226717 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Getting quotas for user 700f40b4567a4bcdbb2194861f4497d5 and project 480896a54dab43c8980c8b05c9a793e7. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:15:16.239741 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:15:16.242143 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:15:16.394456 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:16.397479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a7236899-94a3-4401-962d-8736950a1dde tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.974282 Aug 06 22:15:16.398866 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 316/656] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:15:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:15:16.405467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:16.406305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:16.411788 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:16.415722 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.416533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.417307 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.418268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.418881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.419499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.427566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:16.440096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.443278 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.448209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.450239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.452207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.454993 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.737269 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:16.743941 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:16.753758 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-332382bb-7326-4d1c-bb7b-485c44be38bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.353017 Aug 06 22:15:16.764607 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:16.764607 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:16.764607 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-30562d5a-03ae-44c8-8b0f-7eabc75796e5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1724 microversion: 2.20 time: 0.371532 Aug 06 22:15:16.764945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 341/657] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:16 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1724 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:16.766790 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-12222ce1-dcd0-41bf-b44b-a3b8d0918136 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:16.767768 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-12222ce1-dcd0-41bf-b44b-a3b8d0918136 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:16.768267 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 317/658] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:16 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:16.798408 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c591658-5c00-4e67-aaf2-612afe6a1f38"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:16.807047 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:16.827265 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.828900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.830608 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.831983 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.832849 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.834039 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.839365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-12222ce1-dcd0-41bf-b44b-a3b8d0918136 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:16.839841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:16.852019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-12222ce1-dcd0-41bf-b44b-a3b8d0918136 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1244 microversion: 2.1 time: 0.084867 Aug 06 22:15:16.852019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 342/659] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:16 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:16.925242 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-3140e441-8dac-4991-bf73-164b51c8010b req-ab221b70-3a99-43b9-a8be-3e09d16c8f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae294de-ba68-4354-a1de-e7ba7571b870", "tag": "cf0a94b0-3677-4694-8913-092e34a6b8cf"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:16.956004 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-3140e441-8dac-4991-bf73-164b51c8010b req-ab221b70-3a99-43b9-a8be-3e09d16c8f0d service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:16.957167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-3140e441-8dac-4991-bf73-164b51c8010b req-ab221b70-3a99-43b9-a8be-3e09d16c8f0d service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:16.957986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-3140e441-8dac-4991-bf73-164b51c8010b req-ab221b70-3a99-43b9-a8be-3e09d16c8f0d service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:16.976340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-3140e441-8dac-4991-bf73-164b51c8010b req-ab221b70-3a99-43b9-a8be-3e09d16c8f0d service nova] Creating event network-changed:cf0a94b0-3677-4694-8913-092e34a6b8cf for instance cae294de-ba68-4354-a1de-e7ba7571b870 on hv-cinder-84984 Aug 06 22:15:16.982059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-3140e441-8dac-4991-bf73-164b51c8010b req-ab221b70-3a99-43b9-a8be-3e09d16c8f0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071455 Aug 06 22:15:16.984002 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 343/660] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:17.778446 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:17.779278 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:17.790401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:17.791244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:17.796605 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:17.797411 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:17.797880 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:17.798491 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:17.942116 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:17.949844 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c1ebb375-8709-4833-ac62-b00b06b91efe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.176243 Aug 06 22:15:17.950399 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 344/661] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:17 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:17.954728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:17.955324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:17.961358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:17.961908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:17.962454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:17.963140 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:17.963689 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:17.964112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:18.048129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:18.056148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6cd2d41d-667a-4c92-b8c5-400ef6f1dca2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1248 microversion: 2.1 time: 0.104810 Aug 06 22:15:18.056734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 345/662] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:17 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1248 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:18.078599 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e0ac2f4d-8e89-42af-b1a1-4115f9bdfc40 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.291462 Aug 06 22:15:18.079817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 318/663] 10.222.0.18 () {62 vars in 1364 bytes} [Sat Aug 6 22:15:16 2022] POST /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments => generated 188 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:15:18.204221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:18.204838 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:18.211235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:18.211711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:18.212141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:18.212861 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:18.213308 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:18.213745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:18.256235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118457) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 22:15:18.596739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2efd9b25-49f9-47e6-943b-7f92f484edff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/action" status: 202 len: 0 microversion: 2.20 time: 0.396218 Aug 06 22:15:18.597370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 346/664] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Aug 6 22:15:18 2022] POST /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:15:18.606627 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:18.607441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:18.614720 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:18.619430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:18.619430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:18.619430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:18.619430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:18.619784 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:18.769080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:18.778754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:18.780320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:18.781503 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-61d8ca48-231f-4fb1-bc81-e7085fd35fba tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1750 microversion: 2.20 time: 0.179473 Aug 06 22:15:18.782056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 319/665] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:18 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:18.971534 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:18.972196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:18.978617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:18.979102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:18.979560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:18.981758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:18.991986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:18.991986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:19.076492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:19.077128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:19.083501 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:19.084130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:19.084390 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:19.085252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:19.085712 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:19.086126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:19.123798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:19.133614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-35bd9780-17e8-4936-ab13-0b9548bed8b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.166320 Aug 06 22:15:19.134533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 347/666] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:18 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:19.155776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:19.163600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bba623f2-69fb-4239-87cf-3d8d826335c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1248 microversion: 2.1 time: 0.090839 Aug 06 22:15:19.164468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 320/667] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:19 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:19.807416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:19.808021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:19.814371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:19.817780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:19.817780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:19.817780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:19.817780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:19.818134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:19.966454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:19.970691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:19.977078 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:19.978616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:19.979902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2a254dd8-6579-4c6d-9b93-ad7903136c43 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1750 microversion: 2.20 time: 0.176550 Aug 06 22:15:19.980744 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 348/668] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:19 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:19.993140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1138173685"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:19.993791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:20.000136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.000670 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.001079 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.001772 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.002225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.002644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.155368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:20.156226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:20.164725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.166038 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.166623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.170535 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.170535 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.170535 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.218369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.network.security_group_api [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Adding security group 04f46ec3-50d1-4213-a85f-a21992a3371a to port cf0a94b0-3677-4694-8913-092e34a6b8cf Aug 06 22:15:20.438225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:20.453470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bbcfa45f-2582-44e6-b006-5bc0605b52d5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.302212 Aug 06 22:15:20.464518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 349/669] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:20 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:20.464518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:20.464518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:20.477591 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.478696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.478696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.479285 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.479738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.480153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.620556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:20.627841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1de37610-e46f-4426-9466-a8df5a387ad8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1248 microversion: 2.1 time: 0.172325 Aug 06 22:15:20.628425 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 350/670] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:20 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1248 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:20.828622 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0f669fb5-a748-4f0d-a522-38f6e65dd11c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "POST /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/action" status: 202 len: 0 microversion: 2.1 time: 0.839766 Aug 06 22:15:20.832240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 321/671] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:15:19 2022] POST /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/action => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:15:20.837915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:20.838523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:20.840309 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-202a0705-556c-4341-ba0c-8f36ef81ad7e req-224ab57b-0118-4c68-b21a-cd2aed93a93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae294de-ba68-4354-a1de-e7ba7571b870", "tag": "cf0a94b0-3677-4694-8913-092e34a6b8cf"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:20.844664 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.845138 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.845564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.846355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.846692 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.847108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.851365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-202a0705-556c-4341-ba0c-8f36ef81ad7e req-224ab57b-0118-4c68-b21a-cd2aed93a93e service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:20.851831 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-202a0705-556c-4341-ba0c-8f36ef81ad7e req-224ab57b-0118-4c68-b21a-cd2aed93a93e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:20.852259 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-202a0705-556c-4341-ba0c-8f36ef81ad7e req-224ab57b-0118-4c68-b21a-cd2aed93a93e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:20.864308 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-202a0705-556c-4341-ba0c-8f36ef81ad7e req-224ab57b-0118-4c68-b21a-cd2aed93a93e service nova] Creating event network-changed:cf0a94b0-3677-4694-8913-092e34a6b8cf for instance cae294de-ba68-4354-a1de-e7ba7571b870 on hv-cinder-84984 Aug 06 22:15:20.870888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-202a0705-556c-4341-ba0c-8f36ef81ad7e req-224ab57b-0118-4c68-b21a-cd2aed93a93e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034134 Aug 06 22:15:20.871890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 322/672] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:15:21.005313 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:21.006009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:21.033075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:21.033075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:21.033075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:21.033423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:21.033871 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:21.033871 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:21.033871 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:21.034132 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-820fb563-8beb-4e63-a082-67ed1de8980d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1759 microversion: 2.1 time: 0.188786 Aug 06 22:15:21.034132 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 351/673] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:20 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:21.144931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:21.153581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:21.155052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:21.156229 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-748e2874-32ec-4bb9-a6ff-8fe9f681f9c2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.155110 Aug 06 22:15:21.156809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 323/674] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:20 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:15:21.478423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:21.480434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:21.486084 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:21.486618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:21.487211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:21.488186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:21.488552 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:21.489173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:21.642274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:21.653579 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:21.654468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:21.663180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:21.665327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:21.665969 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:21.666848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:21.667303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:21.667888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:21.670848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f2ddc74c-5202-45e0-947c-f42a014d7c73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.197316 Aug 06 22:15:21.671434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 352/675] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:21 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:21.743971 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:21.760741 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a58d0559-1858-410e-8c7f-6023f3695388 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.105873 Aug 06 22:15:21.762724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 324/676] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:21 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:22.183303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:22.183908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:22.190244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:22.190722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:22.191305 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:22.191994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:22.192472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:22.195746 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:22.323269 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:22.331538 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:22.333050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:22.334185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-14db9302-f823-4c7d-923a-946bf106622d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.154813 Aug 06 22:15:22.335444 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 353/677] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:22 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:22.691657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:22.692254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:22.699335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:22.699804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:22.700234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:22.700949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:22.701399 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:22.701821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:22.782896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:22.783494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:22.789870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:22.790350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:22.791148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:22.791851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:22.792298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:22.792745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:22.843092 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:22.851306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-87ca683e-ce83-474a-b3c5-6cd55e26aa76 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.163422 Aug 06 22:15:22.851890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 325/678] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:22 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:22.862066 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:22.867610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d531f233-4ef1-4029-ac7b-e418213608d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.088551 Aug 06 22:15:22.868203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 354/679] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:22 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:23.359050 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:23.359666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:23.366465 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:23.366964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:23.367400 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:23.368340 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:23.368817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:23.369241 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:23.501264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:23.510166 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:23.511790 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:23.512978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-720c0cd9-d4b7-4678-b72e-89e7a3c33746 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.157995 Aug 06 22:15:23.513539 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 326/680] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:23 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:23.871369 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:23.872181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:23.878466 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:23.878954 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:23.879389 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:23.880181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:23.880938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:23.881076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:23.888979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:23.889729 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:23.896034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:23.896538 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:23.896973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:23.898236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:23.898672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:23.899296 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:23.988068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:23.996620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d37bf944-6020-4fe7-9eaf-350dbff93184 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.111499 Aug 06 22:15:23.997188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 327/681] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:23 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:24.001765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-e3e91ba8-3676-42ad-a62f-225e42303baa req-7059b889-b02c-4322-bdef-f6eaa493f515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590d6f69-cea6-4299-8686-493f521c1e49", "name": "network-vif-plugged", "status": "completed", "tag": "a8980de9-10ab-47ce-a5c4-88df8a79362e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:24.012373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e3e91ba8-3676-42ad-a62f-225e42303baa req-7059b889-b02c-4322-bdef-f6eaa493f515 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:24.012884 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e3e91ba8-3676-42ad-a62f-225e42303baa req-7059b889-b02c-4322-bdef-f6eaa493f515 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:24.013358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e3e91ba8-3676-42ad-a62f-225e42303baa req-7059b889-b02c-4322-bdef-f6eaa493f515 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:24.024989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-e3e91ba8-3676-42ad-a62f-225e42303baa req-7059b889-b02c-4322-bdef-f6eaa493f515 service nova] Creating event network-vif-plugged:a8980de9-10ab-47ce-a5c4-88df8a79362e for instance 590d6f69-cea6-4299-8686-493f521c1e49 on hv-cinder-84984 Aug 06 22:15:24.029843 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-e3e91ba8-3676-42ad-a62f-225e42303baa req-7059b889-b02c-4322-bdef-f6eaa493f515 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031494 Aug 06 22:15:24.030421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 328/682] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:24.048368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:24.055731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d3c0cbb6-aad6-4f6d-b827-1528f54016d7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.188348 Aug 06 22:15:24.056297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 355/683] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:23 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:24.537054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:24.538393 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:24.544487 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:24.544969 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:24.545394 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:24.546074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:24.546516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:24.546932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:24.677942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:24.687244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:24.688774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:24.689940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0fea926f-5d15-4f9b-84d1-2ea823d9125f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.157136 Aug 06 22:15:24.690492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 329/684] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:24 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:25.018093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:25.018710 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:25.025829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:25.026314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:25.026748 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:25.027438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:25.027895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:25.028320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:25.076166 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:25.076806 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:25.083191 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:25.083705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:25.084140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:25.085369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:25.085903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:25.086342 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:25.092635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:25.100783 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-17709876-10eb-47c4-aea1-17f50e676081 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.086228 Aug 06 22:15:25.101356 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 356/685] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:25 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:25.212945 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:25.221695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-287bdc85-43a9-4c95-b5c5-78fd6acf1b8f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.149331 Aug 06 22:15:25.222250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 330/686] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:25 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:25.713176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:25.713794 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:25.719681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:25.720162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:25.720639 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:25.721354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:25.721809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:25.722233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:25.849271 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:25.858028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:25.859507 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:25.860670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f0816213-029e-446e-b941-b6f875a6354c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.151415 Aug 06 22:15:25.861227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 357/687] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:25 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:26.121893 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:26.122495 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:26.128876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:26.129348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:26.129771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:26.130449 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:26.130898 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:26.131318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:26.193704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:26.201152 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-abe3c374-51b3-4017-9123-feb44ca17795 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.083070 Aug 06 22:15:26.201706 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 331/688] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:26 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:26.243685 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:26.244297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:26.250685 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:26.251166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:26.251606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:26.252288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:26.252774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:26.253202 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:26.386173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:26.388995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-51070b07-5a5c-4db5-86d5-c819f59d5113 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.149867 Aug 06 22:15:26.389576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 358/689] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:26 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:26.883818 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:26.884444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:26.886384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:26.887057 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=20 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:26.891887 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:26.892367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:26.892834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:26.893516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:26.893966 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:26.894389 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:27.020285 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:27.029156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:27.030673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:27.032239 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-12d91b76-cc57-4a81-aeb4-bb45f73d172e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.152915 Aug 06 22:15:27.032817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 332/690] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:26 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:27.221623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:27.222227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:27.224064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:27.225170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:27.229725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:27.230248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:27.230672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:27.231349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:27.231793 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:27.232209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:27.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:27.307762 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f9fd2bdc-4758-485c-9532-e15221edf1c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.089920 Aug 06 22:15:27.308324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 359/691] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:27 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:27.410226 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:27.410828 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:27.417219 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:27.417703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:27.418130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:27.418816 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:27.419266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:27.419688 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:27.553059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:27.555787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:27.561672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-db4f2be8-6ee7-49f1-93c7-c3a2ded72a1e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.155228 Aug 06 22:15:27.567702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 333/692] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:27 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:28.055526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:28.056123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:28.062681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:28.063163 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:28.063590 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:28.064262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:28.064734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:28.065150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:28.189828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:28.198037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:28.199519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:28.200683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4b27988b-4c7f-488e-b789-1d34e4002bab tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.149639 Aug 06 22:15:28.201227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 360/693] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:28 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:28.329172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:28.329780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:28.337378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:28.337844 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:28.338275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:28.338960 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:28.339437 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:28.339856 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:28.404419 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:28.411588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-df089864-23e1-4b5d-bdac-642847567532 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.086240 Aug 06 22:15:28.412140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 334/694] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:28 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:28.586693 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:28.587352 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:28.593916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:28.594398 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:28.594828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:28.595508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:28.595955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:28.596368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:28.948773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:28.956047 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-35ca59ed-f3fe-4806-98d4-c0e2209d5d0c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.373770 Aug 06 22:15:28.956631 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 361/695] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:28 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:29.225381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:29.226111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:29.233069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:29.233550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:29.233985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:29.234673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:29.235125 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:29.235548 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:29.362278 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:29.371735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:29.373287 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:29.374450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c4ab8661-9f10-4274-a6b8-c8cc92a4faad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.153800 Aug 06 22:15:29.374993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 335/696] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:29 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:29.433115 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:29.433727 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:29.439672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:29.440153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:29.440629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:29.441317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:29.441800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:29.442250 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:29.505530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:29.513003 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e5c4e2aa-d67c-4504-a9a6-825936368455 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.084708 Aug 06 22:15:29.513563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 362/697] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:29 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:30.030220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:30.030834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:30.036815 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:30.037301 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:30.037938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:30.038631 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:30.039083 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:30.039503 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:30.164730 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:30.171989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-600d116e-27e7-474e-97c3-699dbb4348dd tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.199079 Aug 06 22:15:30.172635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 336/698] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:29 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:30.397340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:30.397938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:30.404352 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:30.404855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:30.405282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:30.405961 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:30.406404 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:30.406817 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:30.534089 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:30.534697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:30.538007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:30.541823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:30.542302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:30.542727 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:30.543423 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:30.543857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:30.544271 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:30.546412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:30.547902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:30.549076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3197d5e3-f05a-4d30-9400-99e14d79e46d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.155844 Aug 06 22:15:30.549633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 363/699] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:30 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:30.608081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:30.615368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5b7952d8-08ff-4eaa-961b-7b9a824556dd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.085149 Aug 06 22:15:30.616551 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 337/700] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:30 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:31.194431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:31.195091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:31.201107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:31.201578 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:31.202172 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:31.202865 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:31.203312 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:31.203730 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:31.332317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:31.340659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3bbef72d-f7d0-4305-a056-a13fa6783686 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.151424 Aug 06 22:15:31.341217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 364/701] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:31 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:31.574249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:31.574806 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:31.581191 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:31.581673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:31.584747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:31.584747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:31.584747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:31.584747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:31.648864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:31.648864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:31.648864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:31.648864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:31.650020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:31.650020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:31.650020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:31.650020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:31.669184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:31.738723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:31.746713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-40f75a48-4790-46ab-9c74-1bf7be6c9ba8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1296 microversion: 2.1 time: 0.114171 Aug 06 22:15:31.760983 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 365/702] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:31 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1296 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:31.761409 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:31.769923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:31.771516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:31.773358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-28cdcb93-3375-45be-9f9c-5207b898d1bc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.203110 Aug 06 22:15:31.773910 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 338/703] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:31 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:32.361924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:32.365397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:32.369774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:32.370258 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:32.370688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:32.371379 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:32.371829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:32.372253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:32.498979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:32.506543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-dcd8f5b6-68de-44a2-9580-6ce62c6abb5c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.148739 Aug 06 22:15:32.507103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 366/704] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:32 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:32.770781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:32.771383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:32.778943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:32.779792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:32.780292 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:32.781023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:32.781481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:32.788287 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:32.892795 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:32.916684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8ea43bf8-dac2-49d5-9d00-3844d66baaac tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1304 microversion: 2.1 time: 0.147260 Aug 06 22:15:32.917811 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 339/705] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:32 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:32.997521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:32.997521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:33.004227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:33.004739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:33.005356 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:33.006750 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:33.007359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:33.007876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:33.148499 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:33.155525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:33.157082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:33.158235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-97a8c9a6-7de4-44f4-bde2-1ec2a6602f6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.363073 Aug 06 22:15:33.158780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 367/706] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:32 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:33.527283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:33.527914 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:33.533844 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:33.534317 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:33.534762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:33.535420 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:33.535864 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:33.536279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:33.666172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:33.673785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-42d89fbf-cda8-44d0-a141-696470a23d1b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.150324 Aug 06 22:15:33.674353 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 340/707] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:33 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:33.941373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:33.941994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:33.951638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:33.952126 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:33.952601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:33.953313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:33.953910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:33.954340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:34.044626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:34.052041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a2fce772-1043-42d2-b107-019fef60180e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1314 microversion: 2.1 time: 0.116427 Aug 06 22:15:34.052646 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 368/708] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:33 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1314 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:34.181407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:34.181967 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:34.188738 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:34.189222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:34.189654 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:34.190348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:34.190845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:34.191291 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:34.405829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:34.414711 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:34.418099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:34.418099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-23eb354e-dd4b-42bc-b4bc-9af261d65eff tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.240735 Aug 06 22:15:34.418631 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 341/709] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:34 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:34.710304 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:34.710304 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:34.714616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:34.715288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:34.716070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:34.717893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:34.718506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:34.719085 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:34.864802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:34.873020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-75e01246-4b8a-4201-ab70-bf60cc055512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.179252 Aug 06 22:15:34.873606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 369/710] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:34 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:35.073046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:35.073681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:35.079684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:35.080160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:35.080628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:35.081306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:35.081753 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:35.082174 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:35.290897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:35.298923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2f0ae625-a876-44ce-9fd8-211f349f8453 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.229697 Aug 06 22:15:35.304240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 342/711] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:35 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:35.440962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:35.441840 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:35.448521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:35.449010 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:35.449451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:35.450155 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:35.450608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:35.451080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:35.641264 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:35.650403 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:35.651884 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:35.653052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-018e8a26-0124-434f-907f-e063b2e4cbc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.216048 Aug 06 22:15:35.653675 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 370/712] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:35 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:35.828175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-16959649-2020-43e9-b0a0-3dfa5ab7bfc5 req-54c3bc72-cf01-4d4f-8bd6-486d0e7558f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d2f2af-bc41-42c1-9546-a62b80daea75", "tag": "028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:35.838100 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-16959649-2020-43e9-b0a0-3dfa5ab7bfc5 req-54c3bc72-cf01-4d4f-8bd6-486d0e7558f0 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:35.838570 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-16959649-2020-43e9-b0a0-3dfa5ab7bfc5 req-54c3bc72-cf01-4d4f-8bd6-486d0e7558f0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:35.838995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-16959649-2020-43e9-b0a0-3dfa5ab7bfc5 req-54c3bc72-cf01-4d4f-8bd6-486d0e7558f0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:35.850139 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-16959649-2020-43e9-b0a0-3dfa5ab7bfc5 req-54c3bc72-cf01-4d4f-8bd6-486d0e7558f0 service nova] Creating event network-changed:028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4 for instance 52d2f2af-bc41-42c1-9546-a62b80daea75 on hv-cinder-84984 Aug 06 22:15:35.855036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-16959649-2020-43e9-b0a0-3dfa5ab7bfc5 req-54c3bc72-cf01-4d4f-8bd6-486d0e7558f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030668 Aug 06 22:15:35.855613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 343/713] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:35.894017 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:35.894622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:35.901132 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:35.901605 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:35.902034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:35.902709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:35.903152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:35.903566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:36.031724 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:36.039221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-867f579e-56cf-493e-bd5a-1e282b49cb2e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.149073 Aug 06 22:15:36.039775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 371/714] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:35 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:36.322810 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:36.323509 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:36.325445 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:36.330295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:36.330775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:36.331206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:36.331889 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:36.332339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:36.332789 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:36.467740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:36.475384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-834beeb9-f76e-4ab6-84f3-1af05bbc6751 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.157902 Aug 06 22:15:36.476064 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 344/715] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:36 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:36.676846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:36.677379 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:36.684446 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:36.684937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:36.685370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:36.686054 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:36.686501 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:36.686919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:36.814915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:36.823466 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:36.825019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:36.826135 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c51600e9-04c2-430b-aa01-3ec0b67fb5b6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.153293 Aug 06 22:15:36.826677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 372/716] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:36 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:37.059788 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:37.060419 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:37.066657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:37.067136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:37.067568 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:37.068247 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:37.068769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:37.069275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:37.197998 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:37.205359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bc9ff31c-d875-4b12-bfd2-e9fa2af1b9c8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.149427 Aug 06 22:15:37.206156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 345/717] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:37 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:37.496590 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:37.497228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:37.503366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:37.503848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:37.504281 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:37.504994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:37.505504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:37.505930 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:37.633064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:37.640257 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f7312447-b9bf-4698-9f40-f6fea15f478e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.147595 Aug 06 22:15:37.640852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 373/718] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:37 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:37.848897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:37.854986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:37.856810 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:37.857292 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:37.857722 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:37.858412 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:37.858865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:37.859310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:37.987090 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:37.996905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:37.998480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:37.999615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9b7da61e-c3d0-4acb-b3c1-d2f32d06b342 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.154710 Aug 06 22:15:38.000159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 346/719] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:37 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:38.227450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:38.228068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:38.234484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:38.234971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:38.235405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:38.236096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:38.236646 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:38.237080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:38.370402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:38.377805 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f6d041ea-dc9a-4102-8df6-e2d6f2d38a8d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1365 microversion: 2.1 time: 0.155326 Aug 06 22:15:38.378367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 374/720] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:38 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:38.661039 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:38.661562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:38.668319 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:38.668826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:38.669254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:38.669932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:38.670378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:38.670794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:38.800193 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:38.807836 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-75573857-52da-4bc1-9570-6cebc1c58f3a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.150657 Aug 06 22:15:38.808417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 347/721] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:38 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:39.025463 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:39.026055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:39.031910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:39.034588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:39.034588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:39.034588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:39.034588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:39.034959 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:39.165441 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:39.173809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:39.175231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:39.176370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bc1cf8d8-12b8-4ab7-81e5-b44ac072dba2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.154921 Aug 06 22:15:39.176977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 375/722] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:39 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:39.398821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:39.399437 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:39.405787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:39.406262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:39.406690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:39.407389 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:39.407837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:39.408253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:39.545863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:39.553427 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-189c0e3d-3379-4d55-9338-6d628bffd20d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1556 microversion: 2.1 time: 0.158987 Aug 06 22:15:39.553982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 348/723] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:39 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:39.573615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:39.574197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:39.580699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:39.581171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:39.581599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:39.582271 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:39.582718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:39.583134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:39.659409 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d5a44728-510c-4914-96f8-5e1789f42e3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089598 Aug 06 22:15:39.659997 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 376/724] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Aug 6 22:15:39 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:39.829196 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:39.829803 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:39.836328 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:39.836837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:39.837266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:39.837954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:39.838397 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:39.838814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:40.089728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:40.097379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0a370166-ed2b-49bf-b90a-da16f60574fd tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.271971 Aug 06 22:15:40.098038 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 349/725] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:39 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:40.199348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:40.199953 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:40.206081 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:40.206565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:40.206995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:40.207720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:40.208168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:40.208613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:40.420424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:40.428943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:40.430449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:40.431638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ec432e75-12b5-4404-8f74-b1807b8b2e7c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1752 microversion: 2.20 time: 0.236289 Aug 06 22:15:40.432440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 377/726] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:40 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1752 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:40.788250 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-b41b2a3d-0b5a-45b3-8be4-2fdc67239890 req-2e6266cb-0973-4a94-849e-9c8905566dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590d6f69-cea6-4299-8686-493f521c1e49", "tag": "a8980de9-10ab-47ce-a5c4-88df8a79362e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:15:40.799147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-b41b2a3d-0b5a-45b3-8be4-2fdc67239890 req-2e6266cb-0973-4a94-849e-9c8905566dc2 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:40.799695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-b41b2a3d-0b5a-45b3-8be4-2fdc67239890 req-2e6266cb-0973-4a94-849e-9c8905566dc2 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:40.800481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-b41b2a3d-0b5a-45b3-8be4-2fdc67239890 req-2e6266cb-0973-4a94-849e-9c8905566dc2 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:40.813014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-b41b2a3d-0b5a-45b3-8be4-2fdc67239890 req-2e6266cb-0973-4a94-849e-9c8905566dc2 service nova] Creating event network-changed:a8980de9-10ab-47ce-a5c4-88df8a79362e for instance 590d6f69-cea6-4299-8686-493f521c1e49 on hv-cinder-84984 Aug 06 22:15:40.817779 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-b41b2a3d-0b5a-45b3-8be4-2fdc67239890 req-2e6266cb-0973-4a94-849e-9c8905566dc2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033379 Aug 06 22:15:40.818403 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 350/727] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:15:41.120553 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:41.122268 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:41.135183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:41.135991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:41.136986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:41.140485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:41.142359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:41.145428 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:41.368219 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:41.375874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0d720557-64bf-4158-9dff-3c55647b3152 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.260467 Aug 06 22:15:41.376470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 378/728] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:41 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:41.457566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:41.458335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:41.467837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:41.468630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:41.469255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:41.470190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:41.470845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:41.471428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:41.702987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:41.705546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:41.713463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:41.714994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:41.716382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-94266b27-0677-4417-8977-9acb83d83fb6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.264642 Aug 06 22:15:41.716960 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 351/729] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:41 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:42.399167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:42.400430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:42.408640 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:42.409818 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:42.410462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:42.411406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:42.412051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:42.412797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:42.653872 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:42.661993 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7deadc9d-712b-4643-a7c6-08df008242a1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.267662 Aug 06 22:15:42.662639 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 379/730] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:42 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:42.741679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:42.742294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:42.748957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:42.749796 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:42.749919 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:42.750560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:42.751039 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:42.751469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:42.907483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:42.916155 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:42.917702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:42.918987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-da1de79e-80ba-4e15-b596-c8ab50abd474 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.181924 Aug 06 22:15:42.919544 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 352/731] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:42 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:43.683261 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:43.683867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:43.690431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:43.690916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:43.691352 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:43.692038 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:43.692521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:43.692949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:43.825302 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:43.832651 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3d58fb47-1550-4877-8821-acf41654ef45 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.153202 Aug 06 22:15:43.833217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 380/732] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:43 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:43.942741 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:43.943471 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:43.949721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:43.950191 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:43.950620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:43.951291 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:43.951735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:43.952149 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:44.079813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:44.089948 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:44.091469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:44.092639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-eba4d8e3-e867-45dd-9864-0529594f9e37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.153784 Aug 06 22:15:44.093184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 353/733] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:43 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:44.854602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:44.855184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:44.861657 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:44.862138 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:44.862566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:44.863238 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:44.863682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:44.864100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:44.995890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:45.003339 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-75d3ef8e-d5c4-44eb-a614-3552babf5b65 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.152604 Aug 06 22:15:45.003893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 381/734] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:44 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:45.116080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:45.116702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:45.123068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:45.123541 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:45.123967 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:45.124678 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:45.125126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:45.125543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:45.257300 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:45.265587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:45.267070 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:45.268232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1a86d98d-75cc-4803-9a20-b59fdca2efb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.156837 Aug 06 22:15:45.268810 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 354/735] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:45 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:46.023080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:46.023712 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:46.030099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:46.030577 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:46.031004 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:46.031678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:46.032123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:46.032571 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:46.050249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:46.159121 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:46.166640 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f104a8ff-e0bc-4d34-9eec-799a1e358249 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.147486 Aug 06 22:15:46.167200 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 382/736] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:46 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:46.292150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:46.292706 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:46.299010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:46.299482 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:46.299910 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:46.300618 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:46.301065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:46.301482 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:46.436901 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:46.445452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:46.446939 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:46.448082 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-30baea71-bc68-4926-9115-914aabb59c6b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.159871 Aug 06 22:15:46.448673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 355/737] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:46 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:47.189142 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:47.190550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:47.198956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:47.199726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:47.200573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:47.201174 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:47.201625 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:47.202042 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:47.333612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:47.342196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ddbd7f63-d374-47a7-b88c-3b1810048049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.157646 Aug 06 22:15:47.342766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 383/738] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:47 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:47.470778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:47.471348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:47.478406 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:47.478881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:47.479329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:47.479993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:47.480482 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:47.480906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:47.610359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:47.619281 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:47.620811 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:47.621963 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2f3b6026-20c2-4d32-a8ea-1db8e18497ad tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.155147 Aug 06 22:15:47.622511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 356/739] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:47 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:48.363253 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:48.364142 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:48.371287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:48.371795 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:48.372227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:48.374262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:48.374262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:48.374262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:48.509598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:48.517653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3163aa10-3149-4bca-8c34-6bf05664d74a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.158015 Aug 06 22:15:48.530645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 384/740] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:48 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:48.645474 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:48.646108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:48.653078 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:48.653542 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:48.653973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:48.654654 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:48.655108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:48.655527 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:48.795316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:48.805110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:48.806862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:48.808208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-739fe8fc-8e49-470f-9a7a-db21b8a3ab2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.166558 Aug 06 22:15:48.808782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 357/741] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:48 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:49.539573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:49.539573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:49.546001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:49.546490 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:49.546926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:49.547612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:49.548063 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:49.548521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:49.739733 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:49.747756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-dd1a6b7f-8b01-4804-8c04-1d74cd2e3527 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.213287 Aug 06 22:15:49.748434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 385/742] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:49 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:49.834493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:49.835097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:49.841592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:49.842069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:49.842496 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:49.843178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:49.843631 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:49.844050 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:50.022151 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:50.029930 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:50.031463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:50.032722 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e0b4dce7-1c2d-4610-abad-c3cdbd53156c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.202847 Aug 06 22:15:50.033443 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 358/743] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:49 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:50.770949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:50.772171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:50.779415 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:50.780191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:50.780454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:50.781044 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:50.781498 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:50.781923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:50.942168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:50.951268 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c6347c66-3865-4c9c-9e8d-e5f20eafe2f2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.185384 Aug 06 22:15:50.951835 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 386/744] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:50 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:51.056680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:51.057286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:51.064133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:51.064650 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:51.065076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:51.066102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:51.066774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:51.067405 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:51.205620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:51.214338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:51.215822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:51.217002 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0df3096a-e4d9-4ae8-b901-458a5e74de66 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.164344 Aug 06 22:15:51.217557 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 359/745] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:51 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:51.881037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:51.881037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:51.883656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:51.884133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:51.884600 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:51.885289 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:51.885737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:51.886159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:51.972983 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:51.973665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:51.975645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lazy-loading 'services' on Instance uuid 74bb920d-a774-46ac-9b12-a2668c3c4c00 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:15:51.980186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:51.980710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:51.981145 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:51.981844 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:51.982293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:51.982717 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:52.118128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:52.126650 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ba1c1609-7f77-49f2-8603-5a5b265faeb5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.157427 Aug 06 22:15:52.127639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 360/746] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:51 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:15:52.209854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fec06ac6-6faa-44f3-8850-39e9164f24fa tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "DELETE /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00/os-volume_attachments/5263c354-23a0-4c41-9b07-3f1c5642de03" status: 202 len: 0 microversion: 2.1 time: 0.336727 Aug 06 22:15:52.212953 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 387/747] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:15:51 2022] DELETE /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00/os-volume_attachments/5263c354-23a0-4c41-9b07-3f1c5642de03 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:15:52.239063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:52.241827 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:52.247277 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:52.247906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:52.248337 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:52.249070 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:52.249634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:52.250028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:52.393481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:52.402382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:52.403881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:52.405053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e2cedb5f-29ae-4bae-8dad-74c6a1d2829d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.169900 Aug 06 22:15:52.405606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 361/748] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:52 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:53.150987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:53.151683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:53.159206 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:53.159828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:53.160429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:53.161293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:53.162134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:53.162844 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:53.334988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:53.346504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-860be311-e37b-4b4d-98e0-617422240777 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.201188 Aug 06 22:15:53.347719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 388/749] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:53 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:53.428021 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:53.428735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:53.435096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:53.435576 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:53.436226 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:53.436875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:53.437334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:53.437752 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:53.586110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:53.586110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:53.586330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:53.586330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b942e1c2-cb7c-46b7-bdc0-bfe088c8c648 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.160965 Aug 06 22:15:53.586330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 362/750] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:53 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:54.371634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:54.372332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:54.378498 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:54.378983 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:54.379418 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:54.380114 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:54.380660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:54.381083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:54.523581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:54.531235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9aab656c-a873-4f6f-b7db-86423381e7c2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.163625 Aug 06 22:15:54.532091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 389/751] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:54 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:54.608571 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:54.609227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:54.616481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:54.616981 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:54.617416 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:54.618128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:54.618585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:54.619013 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:54.756858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:54.765385 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:54.766882 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:54.768085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3db8e4b2-f287-4fbe-999e-c0ffba0113f2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.163515 Aug 06 22:15:54.768668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 363/752] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:54 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:55.557550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:55.558161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:55.564547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:55.565034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:55.565469 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:55.566153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:55.566606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:55.567028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:55.706914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:55.714897 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6e6212c3-41b5-4ee1-902e-369b9d57f822 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.161306 Aug 06 22:15:55.715462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 390/753] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:55 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:55.791352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:55.791964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:55.798906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:55.799482 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:55.799982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:55.800813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:55.801303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:55.801801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:55.937938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:55.946797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:55.948285 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:55.949494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-cc44193d-8dc8-4723-8e3d-0cd49b72e717 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.162308 Aug 06 22:15:55.950037 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 364/754] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:55 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:56.735170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:56.735836 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:56.743335 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:56.743818 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:56.744252 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:56.744965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:56.745415 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:56.745842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:56.882258 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:56.889823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0af9db62-d940-453a-8836-baf6914a680e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.158595 Aug 06 22:15:56.890682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 391/755] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:56 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:56.973045 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:56.973652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:56.980733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:56.981212 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:56.981646 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:56.982329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:56.982780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:56.983203 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:57.122082 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:57.131023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:57.132529 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:57.133718 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-601f6412-3368-460d-b1c2-bb5e339faeeb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.164582 Aug 06 22:15:57.134326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 365/756] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:56 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:57.910708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:57.912282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:57.918777 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:57.919260 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:57.919691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:57.920391 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:57.920873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:57.921297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:58.060700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:58.068159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e4e6e734-04af-414f-bec1-87eb6ddd91b8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.161378 Aug 06 22:15:58.068746 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 392/757] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:57 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:58.157476 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:58.158080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:58.166488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:58.166488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:58.166488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:58.166892 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:58.167341 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:58.167762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:58.308856 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:58.317846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:58.319339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:58.320541 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-126fb470-a041-40f9-9ccf-a7868e36cfd6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.167060 Aug 06 22:15:58.321404 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 366/758] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:58 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:15:59.089834 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:59.090487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:59.092955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=68 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:59.097567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:59.098043 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:59.098473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:59.099151 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:59.099863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:59.100280 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:59.236684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:59.244650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0d0c3c3a-b516-49b0-8062-45e47d1bd3ba tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.158783 Aug 06 22:15:59.245230 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 393/759] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:15:59 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:15:59.344143 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:15:59.344709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:15:59.351687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:59.352166 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:59.352625 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:59.353425 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:15:59.353755 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:15:59.354175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:15:59.486162 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:59.495857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:59.497393 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:15:59.498720 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7394b15e-b12f-48b7-a37c-0a7a7e72eac2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.158417 Aug 06 22:15:59.499989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 367/760] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:15:59 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:00.267013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:00.280822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:00.280822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:00.280822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:00.280822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:00.281293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:00.281293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:00.281293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:00.437917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:00.446599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6cd5505d-dade-49c9-9a5c-5bcd6aced255 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.184065 Aug 06 22:16:00.447286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 394/761] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:00 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:00.523863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:00.524597 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:00.531420 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:00.531906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:00.532453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:00.533150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:00.533709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:00.534142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:00.554014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:16:00.678832 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:00.687056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:00.688569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:00.689711 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a3d6afa4-fb24-4d2f-a2c4-aaa31e8faa28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.170084 Aug 06 22:16:00.690252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 368/762] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:00 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:01.467875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:01.468511 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:01.475348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:01.476659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:01.476659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:01.476955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:01.477408 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:01.477829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:01.611340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:01.619452 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c0f7ec25-be2f-4ccf-9b0a-28e3e56e8238 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.155514 Aug 06 22:16:01.620015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 395/763] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:01 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:01.712767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:01.713407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:01.719745 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:01.720223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:01.720690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:01.721462 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:01.721940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:01.722360 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:01.866099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:01.874924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:01.876423 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:01.877617 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d920344b-42c9-4a7d-922e-1673a3fb2edb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.169028 Aug 06 22:16:01.878167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 369/764] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:01 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:02.641073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:02.641630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:02.648539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:02.649018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:02.649451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:02.650123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:02.650567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:02.650982 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:02.778998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:02.786411 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-82cb9f66-a265-4f29-84fb-b3cc135be941 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.149175 Aug 06 22:16:02.786962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 396/765] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:02 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:02.902043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:02.902660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:02.909248 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:02.909733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:02.910167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:02.911183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:02.911975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:02.912777 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:03.041696 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:03.049922 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:03.051458 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:03.052650 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-914a6559-cc4e-4145-9d57-b3590188562f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.154532 Aug 06 22:16:03.053202 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 370/766] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:02 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:03.808129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:03.808765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:03.815167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:03.815644 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:03.816080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:03.816790 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:03.817249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:03.817673 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:03.948541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:03.955759 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a57540b0-5bcf-4a46-a6cb-168a0358bd10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.151511 Aug 06 22:16:03.956547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 397/767] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:03 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:04.075288 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:04.075832 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:04.082306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:04.082785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:04.083800 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:04.084510 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:04.084965 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:04.085413 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:04.213709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:04.221986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:04.223494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:04.225966 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4cb518d1-2780-4358-acbf-2e4de6966e09 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.154671 Aug 06 22:16:04.226529 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 371/768] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:04 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:04.977869 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:04.978605 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:04.985120 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:04.985603 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:04.986037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:04.986729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:04.987181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:04.987602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:05.007889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:16:05.120035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:05.127313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b9e74777-57d5-4a20-bc6b-b812bfae9add tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.153727 Aug 06 22:16:05.127913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 398/769] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:04 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:05.248891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:05.249496 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:05.256035 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:05.257555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:05.257555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:05.257884 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:05.258340 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:05.258764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:05.390540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:05.400205 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:05.401728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:05.402883 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4204d31e-aa1c-4c83-8bfe-f7d1fdaca33e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.157956 Aug 06 22:16:05.403437 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 372/770] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:05 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:06.148314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:06.148951 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:06.156034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:06.156548 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:06.156980 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:06.157667 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:06.158115 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:06.158543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:06.293087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:06.300429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5aaba446-17e0-493e-8128-629a008cd7c0 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.156456 Aug 06 22:16:06.301053 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 399/771] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:06 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:06.426450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:06.427505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:06.434165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:06.434687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:06.435096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:06.435817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:06.436260 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:06.436724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:06.565038 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:06.573923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:06.575424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:06.576601 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-aefd0f73-2857-48bb-b555-1500c2d074db tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.153996 Aug 06 22:16:06.577154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 373/772] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:06 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:07.321722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:07.322323 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:07.328658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:07.329132 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:07.329565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:07.330239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:07.330683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:07.331101 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:07.461202 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:07.468517 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ebbe5caf-e68a-455d-b8df-983b47cb3cca tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.151296 Aug 06 22:16:07.469077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 400/773] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:07 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:07.599405 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:07.600021 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:07.602338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=60 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:16:07.607048 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:07.607471 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:07.607905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:07.608620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:07.609069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:07.609492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:07.739648 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:07.749016 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:07.750629 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:07.751895 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2cd44053-d0fa-4926-b34e-ee81a3c39c8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.156795 Aug 06 22:16:07.752511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 374/774] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:07 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:08.489080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:08.494822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:08.496181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:08.496686 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:08.497120 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:08.497803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:08.498299 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:08.498744 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:08.630522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:08.637968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d197e42d-2863-41d4-9aca-56f01cabc252 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.152886 Aug 06 22:16:08.638522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 401/775] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:08 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:08.775743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:08.776366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:08.782885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:08.783367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:08.783809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:08.784520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:08.784982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:08.785410 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:08.917234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:08.925511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:08.927097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:08.928255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-da5541ce-dd1c-4e11-9b40-9072c9468f3a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.156420 Aug 06 22:16:08.928854 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 375/776] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:08 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:09.658849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:09.659449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:09.666460 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:09.666937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:09.667364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:09.668040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:09.668508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:09.668929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:09.799057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:09.807082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-74bd45cd-fc22-408c-8d09-e17f94b4c58a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.152091 Aug 06 22:16:09.807639 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 402/777] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:09 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:09.952053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:09.952623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:09.959566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:09.960044 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:09.960508 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:09.961192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:09.961642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:09.962064 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:10.089094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:10.097474 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:10.098991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:10.100422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-53e14e5f-b05f-4c2f-8929-0978901ef9da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.152271 Aug 06 22:16:10.100977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 376/778] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:09 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:10.827521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:10.828049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:10.834774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:10.835254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:10.835688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:10.836374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:10.836849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:10.837311 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:10.965781 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:10.973319 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ab45b642-6c44-4e55-baad-6ca1f81169d1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.149725 Aug 06 22:16:10.973890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 403/779] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:10 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:11.124188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:11.124791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:11.131143 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:11.131620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:11.132046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:11.132753 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:11.133200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:11.133613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:11.277569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:11.277569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:11.277858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:11.277858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3ebb31e1-32f1-4af3-91d5-0d76c6ba5ff2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.154677 Aug 06 22:16:11.277858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 377/780] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:11 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:11.994397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:11.994999 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:12.001345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:12.001823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:12.002249 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:12.002928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:12.003377 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:12.003793 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:12.128652 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:12.136527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ddc663d4-2069-44a7-8122-e3ea9b21355d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.145941 Aug 06 22:16:12.137081 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 404/781] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:11 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:12.298899 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:12.299537 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:12.306363 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:12.306845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:12.307281 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:12.307964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:12.308440 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:12.309134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:12.441081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:12.450419 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:12.451943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:12.453169 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e7909287-f468-46cc-81a5-5ed00a1faff0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.158309 Aug 06 22:16:12.453727 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 378/782] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:12 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:12.741728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-e6027a9e-ceeb-4bac-8d0c-e533c139d6a8 req-f5132ece-2668-41b0-9580-913abb77cf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d2f2af-bc41-42c1-9546-a62b80daea75", "name": "network-vif-plugged", "status": "completed", "tag": "028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:16:12.751468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e6027a9e-ceeb-4bac-8d0c-e533c139d6a8 req-f5132ece-2668-41b0-9580-913abb77cf52 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:12.751946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e6027a9e-ceeb-4bac-8d0c-e533c139d6a8 req-f5132ece-2668-41b0-9580-913abb77cf52 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:12.752383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e6027a9e-ceeb-4bac-8d0c-e533c139d6a8 req-f5132ece-2668-41b0-9580-913abb77cf52 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:12.763120 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-e6027a9e-ceeb-4bac-8d0c-e533c139d6a8 req-f5132ece-2668-41b0-9580-913abb77cf52 service nova] Creating event network-vif-plugged:028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4 for instance 52d2f2af-bc41-42c1-9546-a62b80daea75 on hv-cinder-84984 Aug 06 22:16:12.768170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-e6027a9e-ceeb-4bac-8d0c-e533c139d6a8 req-f5132ece-2668-41b0-9580-913abb77cf52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030663 Aug 06 22:16:12.768804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 405/783] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:16:13.157072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:13.157633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:13.164355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:13.164869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:13.165332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:13.166021 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:13.166471 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:13.166891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:13.293094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:13.300701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-98ce32fa-9d4e-484c-8953-e8ba37cb6df5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.147430 Aug 06 22:16:13.303966 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 379/784] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:13 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:13.477549 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:13.478228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:13.484276 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:13.484782 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:13.485218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:13.485908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:13.486356 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:13.486780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:13.617016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:13.625350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:13.626839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:13.627985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-100e8a50-dc74-4b6f-bb31-bd466657f1d4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.155570 Aug 06 22:16:13.628561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 406/785] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:13 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:14.322416 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:14.323061 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:14.329507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:14.329990 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:14.330429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:14.331108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:14.331560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:14.332029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:14.465522 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:14.472965 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7108bdd9-94fc-474f-9156-a28a78a7fd2d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.154460 Aug 06 22:16:14.474412 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 380/786] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:14 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:16:14.652035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:14.652609 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:14.659183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:14.659677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:14.660117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:14.661506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:14.661960 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:14.662385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:14.788514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:14.796948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:14.798462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:14.799611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9993693f-ceb5-4972-bbc2-3dfb3c1bd89e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.151612 Aug 06 22:16:14.800172 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 407/787] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:14 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:15.496361 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:15.497069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:15.503925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:15.505106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:15.505545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:15.506244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:15.508120 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:15.508120 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:15.649540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:15.657105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8c5780dc-0f78-4522-8f48-e52e58922e22 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.165498 Aug 06 22:16:15.657663 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 381/788] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:15 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:15.822840 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:15.823401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:15.829718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:15.830215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:15.830641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:15.831316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:15.831760 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:15.832175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:15.962668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:15.971129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:15.972659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:15.975110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f7036e15-610f-44a5-aeb3-d1d979c67966 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.156185 Aug 06 22:16:15.975673 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 408/789] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:15 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:16.678671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:16.679322 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:16.685703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:16.686186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:16.686615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:16.687300 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:16.687743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:16.688159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:16.820611 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:16.827987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e13c46ba-4d41-4b9c-ae45-1a598d9841f3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.153601 Aug 06 22:16:16.828837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 382/790] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:16 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:16.997726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:16.998329 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:17.005395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:17.006093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:17.006530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:17.007221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:17.007670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:17.008092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:17.133956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:17.142357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:17.143861 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:17.145279 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fbf5b763-96ae-4104-9ad2-70e770694eb9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.151399 Aug 06 22:16:17.145876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 409/791] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:16 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:16:17.712961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:17.713468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:17.719926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:17.722472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:17.722472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:17.722472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:17.722472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:17.723649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:17.748092 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:16:17.849885 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:17.850479 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:17.856554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:17.857037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:17.857467 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:17.858213 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:17.858664 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:17.859170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:17.860080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:16:17.989058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:17.996628 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1df8e8a4-7fea-4229-a206-8e47dd300b10 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.150968 Aug 06 22:16:17.997203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 410/792] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:17 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:16:18.061133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bac358d4-22af-4a70-bf38-566615ba1b72 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "DELETE /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 204 len: 0 microversion: 2.1 time: 0.351759 Aug 06 22:16:18.061727 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 383/793] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:16:17 2022] DELETE /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 22:16:18.070265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:18.070880 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:18.077174 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:18.077655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:18.078089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:18.078775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:18.079242 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:18.079645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:18.167726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:18.168445 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:18.174677 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:18.175165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:18.175598 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:18.177415 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:18.177900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:18.178326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:18.213462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:18.220948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bab44044-a651-424e-8b0d-68377a551876 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1514 microversion: 2.1 time: 0.155063 Aug 06 22:16:18.221512 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 411/794] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:18 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:18.306658 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:18.314924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:18.316417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:18.318374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ce8c12c8-1c9e-4a8c-8bcd-2d48d406ac8a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.154967 Aug 06 22:16:18.318937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 384/795] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:18 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:16:19.018741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:19.019259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:19.026065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:19.026562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:19.026998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:19.027695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:19.028147 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:19.028623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:19.158358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:19.166355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-16b02048-ad46-4f01-b633-834b19dcaa55 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1369 microversion: 2.1 time: 0.151686 Aug 06 22:16:19.166915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 412/796] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:19 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:19.241702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:19.242312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:19.248882 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:19.249357 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:19.249786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:19.250466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:19.250916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:19.251335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:19.341420 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:19.342028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:19.348438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:19.348803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:19.349509 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:19.350216 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:19.350778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:19.351250 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:19.384570 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:19.392258 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ed9f9b95-11d2-4d5d-a2a7-67755b48b2f1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1514 microversion: 2.1 time: 0.154508 Aug 06 22:16:19.392851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 385/797] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:19 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:19.480255 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:19.488844 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:19.490349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:19.491502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4c0528cb-3691-4b55-bd59-8b08d11d2998 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.153980 Aug 06 22:16:19.492057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 413/798] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:19 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:16:20.186972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:20.187732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:20.193783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:20.194263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:20.194697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:20.195380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:20.195838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:20.196258 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:20.415241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:20.415951 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:20.422619 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:20.423104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:20.423536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:20.424233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:20.424712 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:20.425133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:20.623118 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:20.625856 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:20.631133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8d18ab90-82ef-4b2c-a7fc-af34b92ed717 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1563 microversion: 2.1 time: 0.447893 Aug 06 22:16:20.631709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 386/799] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:20 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1563 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:20.633794 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b3bd7fa7-87c1-4313-a64d-b43fb8ba49a1 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1514 microversion: 2.1 time: 0.222353 Aug 06 22:16:20.634360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 414/800] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:20 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:16:20.636230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:20.636867 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:20.642796 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:20.643286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:20.643719 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:20.644421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:20.645818 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:20.646401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:20.652737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:20.653226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:20.659061 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:20.659540 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:20.659971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:20.661473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:20.661897 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:20.662317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:20.763622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ddc5f85c-9e9d-467a-80bd-e868672211b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114573 Aug 06 22:16:20.764211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 415/801] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Aug 6 22:16:20 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:16:20.808055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:20.816882 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:20.818689 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:20.819863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1f9bdf99-dcbb-41f5-9a0b-169db3953ac5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.187243 Aug 06 22:16:20.820640 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 387/802] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:20 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:21.655696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:21.656306 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:21.663409 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:21.664705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:21.664705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:21.665274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:21.665730 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:21.666152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:21.671314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:16:21.803990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:21.816285 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c4373856-db54-4027-abd8-c6cd17c2702b tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1514 microversion: 2.1 time: 0.164929 Aug 06 22:16:21.816968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 416/803] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:21 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:21.843332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:21.843939 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:21.851489 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:21.852037 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:21.852562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:21.853259 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:21.853772 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:21.854112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:21.997745 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:22.010719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-f71da126-2675-43e2-8ff0-562e39cc7206 req-52532ae9-a5ee-4cf0-8d4a-04a111a9b8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bb920d-a774-46ac-9b12-a2668c3c4c00", "name": "network-vif-deleted", "tag": "fc5e00ba-86fd-486f-99b6-958f4f7d5e5f"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:16:22.018626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:22.020717 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:22.021479 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f71da126-2675-43e2-8ff0-562e39cc7206 req-52532ae9-a5ee-4cf0-8d4a-04a111a9b8e7 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:22.021986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b1d4fa78-505f-4c30-9dd6-b2bc19fa9988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.182678 Aug 06 22:16:22.022099 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f71da126-2675-43e2-8ff0-562e39cc7206 req-52532ae9-a5ee-4cf0-8d4a-04a111a9b8e7 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:22.022541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f71da126-2675-43e2-8ff0-562e39cc7206 req-52532ae9-a5ee-4cf0-8d4a-04a111a9b8e7 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:22.027702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 388/804] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:21 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:22.034040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-f71da126-2675-43e2-8ff0-562e39cc7206 req-52532ae9-a5ee-4cf0-8d4a-04a111a9b8e7 service nova] Creating event network-vif-deleted:fc5e00ba-86fd-486f-99b6-958f4f7d5e5f for instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 on hv-cinder-84984 Aug 06 22:16:22.039976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-f71da126-2675-43e2-8ff0-562e39cc7206 req-52532ae9-a5ee-4cf0-8d4a-04a111a9b8e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173062 Aug 06 22:16:22.040931 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 417/805] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:16:22.839338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:22.839953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:22.845899 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:22.846518 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:22.846830 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:22.848167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:22.848653 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:22.849354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:22.912081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:22.919723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3aba499c-4995-4c68-9f4a-d1f658b73466 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1472 microversion: 2.1 time: 0.084324 Aug 06 22:16:22.920294 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 389/806] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:22 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:16:23.046504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:23.047137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:23.053704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:23.054185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:23.054614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:23.055300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:23.055752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:23.056168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:23.203939 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:23.213831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:23.215430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:23.216900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-12468121-63ab-46ec-8926-af44fe70fcfb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.175061 Aug 06 22:16:23.217570 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 418/807] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:23 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:23.941589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:23.942264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:23.948748 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:23.949230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:23.949660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:23.950344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:23.950793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:23.951213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:23.982053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:23.982528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:23.982958 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:23.983404 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lazy-loading 'fault' on Instance uuid 74bb920d-a774-46ac-9b12-a2668c3c4c00 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:16:24.023636 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56138f43f00e46ea9dda399a0fb0e822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2fb805386743d1a4bfd3b15bde695c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:24.031277 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2c788070-7c8c-44cf-a7dc-7692ac7a4661 tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 200 len: 1309 microversion: 2.1 time: 0.093500 Aug 06 22:16:24.031805 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 390/808] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:23 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:16:24.074166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-5daa9486-66cb-4708-8928-9bd4c3ee7604 req-1b561a15-8e3c-4b5b-baf8-070a49eb2764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d2f2af-bc41-42c1-9546-a62b80daea75", "tag": "028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:16:24.083971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-5daa9486-66cb-4708-8928-9bd4c3ee7604 req-1b561a15-8e3c-4b5b-baf8-070a49eb2764 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:24.084469 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-5daa9486-66cb-4708-8928-9bd4c3ee7604 req-1b561a15-8e3c-4b5b-baf8-070a49eb2764 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:24.084895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-5daa9486-66cb-4708-8928-9bd4c3ee7604 req-1b561a15-8e3c-4b5b-baf8-070a49eb2764 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:24.095302 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-5daa9486-66cb-4708-8928-9bd4c3ee7604 req-1b561a15-8e3c-4b5b-baf8-070a49eb2764 service nova] Creating event network-changed:028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4 for instance 52d2f2af-bc41-42c1-9546-a62b80daea75 on hv-cinder-84984 Aug 06 22:16:24.100893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-5daa9486-66cb-4708-8928-9bd4c3ee7604 req-1b561a15-8e3c-4b5b-baf8-070a49eb2764 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030386 Aug 06 22:16:24.101457 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 419/809] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:16:24.242045 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:24.242742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:24.248690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:24.249173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:24.249603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:24.250287 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:24.250736 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:24.251156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:24.386866 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:24.395977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:24.397849 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:24.399000 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9dcb9d90-1d05-4e83-a5c4-40ab78886190 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.161812 Aug 06 22:16:24.399738 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 391/810] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:24 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:25.057471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:25.058186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] [instance: 74bb920d-a774-46ac-9b12-a2668c3c4c00] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:25.064208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:25.064712 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:25.065141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:25.065813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:25.066902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:25.067387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:25.080656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] HTTP exception thrown: Instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 could not be found. Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Request method failure captured: Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 HTTP/1.1 Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ucixdEE1jyH-3YDZyb-aDoTr2Y7XUGJDEu-Os51OoN_2E98_7d9zFoG9X_Vdic483Thn3r0t_7XrwfIGQM-a_5HJynmhuMMiPBEKvAmRUvoA_eIAZYpbxtw2xYdGOeouZCz2sSEzm5vdWVvipgMWJs-sTJv42apz0_dKVgSzlJrs6w Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: dc2fb805386743d1a4bfd3b15bde695c Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesSnapshotTestJSON-320893733 Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:16:25.082360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dc2fb805386743d1a4bfd3b15bde695c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dc2fb805386743d1a4bfd3b15bde695c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dc2fb805386743d1a4bfd3b15bde695c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dc2fb805386743d1a4bfd3b15bde695c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesSnapshotTestJSON-320893733 Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: dc2fb805386743d1a4bfd3b15bde695c Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-320893733 Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesSnapshotTestJSON-320893733-project Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 56138f43f00e46ea9dda399a0fb0e822 Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesSnapshotTestJSON-320893733-project Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 could not be found. Aug 06 22:16:25.084726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '74bb920d-a774-46ac-9b12-a2668c3c4c00'} Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 could not be found. Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:16:25.086191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 could not be found. Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 could not be found. Aug 06 22:16:25.088470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:16:25.090621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] Returning 404 to user: Instance 74bb920d-a774-46ac-9b12-a2668c3c4c00 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:16:25.090621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-45e070cd-2939-4632-8419-5ad41c6337bc tempest-VolumesSnapshotTestJSON-320893733 tempest-VolumesSnapshotTestJSON-320893733-project] 10.222.0.18 "GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00" status: 404 len: 111 microversion: 2.1 time: 0.030467 Aug 06 22:16:25.090621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 420/811] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:16:25 2022] GET /compute/v2.1/servers/74bb920d-a774-46ac-9b12-a2668c3c4c00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:16:25.317847 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-8dc04e21-74d1-44e7-9bdb-89a60ce911d3 req-c0a48d2e-d4fc-4998-8857-f73f14ea8cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209d7c8e-59b6-4313-a518-a2c8c7eeb290", "name": "network-vif-plugged", "status": "completed", "tag": "608fc1c7-cd79-4b52-883b-01561aed2ea4"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:16:25.327105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-8dc04e21-74d1-44e7-9bdb-89a60ce911d3 req-c0a48d2e-d4fc-4998-8857-f73f14ea8cac service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:25.332616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-8dc04e21-74d1-44e7-9bdb-89a60ce911d3 req-c0a48d2e-d4fc-4998-8857-f73f14ea8cac service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:25.332616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-8dc04e21-74d1-44e7-9bdb-89a60ce911d3 req-c0a48d2e-d4fc-4998-8857-f73f14ea8cac service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:25.339024 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-8dc04e21-74d1-44e7-9bdb-89a60ce911d3 req-c0a48d2e-d4fc-4998-8857-f73f14ea8cac service nova] Creating event network-vif-plugged:608fc1c7-cd79-4b52-883b-01561aed2ea4 for instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 on hv-cinder-84984 Aug 06 22:16:25.343970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-8dc04e21-74d1-44e7-9bdb-89a60ce911d3 req-c0a48d2e-d4fc-4998-8857-f73f14ea8cac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090509 Aug 06 22:16:25.344593 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 392/812] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:16:25.423790 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:25.424796 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:25.431469 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:25.431988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:25.432643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:25.433497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:25.433783 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:25.434592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:25.572551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:25.581155 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:25.582661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:25.583899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4686c964-1fab-44a8-ad77-a59b4e2e6138 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.164480 Aug 06 22:16:25.584459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 421/813] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:25 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:26.608106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:26.608835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:26.615643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:26.616126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:26.616592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:26.617277 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:26.617726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:26.618147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:26.748179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:26.758036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:26.759614 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:26.760827 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8d29f0ec-c0e0-444a-9e40-df466f7d0fb1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.157392 Aug 06 22:16:26.761459 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 393/814] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:26 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:27.784089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:27.784721 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:27.791334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:27.791814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:27.793186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:27.793186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:27.793433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:27.793854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:27.927908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:27.936254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:27.937864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:27.939006 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4edadefa-e3e4-47a9-b9b5-fe39967082a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.158950 Aug 06 22:16:27.939566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 422/815] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:27 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:28.966972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:28.967580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:28.974315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:28.974792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:28.975225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:28.975902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:28.976352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:28.976799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:29.107943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:29.116973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:29.118467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:29.119698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-adc8679f-7eb4-400a-95a9-6d294b94b3d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.156636 Aug 06 22:16:29.120255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 394/816] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:28 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:30.142408 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:30.143023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:30.146431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=60 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:16:30.151105 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:30.151585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:30.152025 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:30.152797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:30.153271 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:30.153720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:30.287313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:30.295655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:30.297184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:30.298337 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7069aa1c-b96f-4d8a-a380-79b68b074f97 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.159892 Aug 06 22:16:30.298886 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 423/817] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:30 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:16:31.321928 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:31.322528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:31.329140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:31.329620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:31.330046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:31.330724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:31.331165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:31.331579 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:31.463804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:31.472301 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:31.473822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:31.475614 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1d1eef7d-a1b6-4c07-8086-cfb61645cc2b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1808 microversion: 2.20 time: 0.158109 Aug 06 22:16:31.476177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 395/818] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:31 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:16:32.498046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:16:32.498754 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:16:32.505932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:32.506425 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:32.506857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:32.507536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:16:32.507986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:16:32.508421 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:16:32.634859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:32.643198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:32.644745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:16:32.645896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2c094573-3e7f-4680-b6a4-0956ad689069 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1795 microversion: 2.20 time: 0.151791 Aug 06 22:16:32.646441 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 424/819] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:16:32 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:17:12.989132 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:17:12.989845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:17:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:17:19.089963 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:19.092307 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:19.094747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:19.095423 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:19.100467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:19.100959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:19.101395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:19.102117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:19.102574 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:19.103001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:19.359852 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-08a875db-3aee-4c78-9d62-fa8f083bdd0d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "POST /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/action" status: 202 len: 0 microversion: 2.1 time: 0.273624 Aug 06 22:17:19.361369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 396/820] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:17:19 2022] POST /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:17:19.368670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:19.369280 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:19.371574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:19.372228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=40 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:19.377178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:19.377665 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:19.378095 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:19.378819 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:19.379262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:19.379682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:19.530488 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:19.538672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e150fb09-3727-450c-9bdd-33c202f2695d tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1751 microversion: 2.1 time: 0.173913 Aug 06 22:17:19.539438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 425/821] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:19 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:20.561618 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:20.562313 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:20.568874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:20.569353 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:20.569780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:20.570467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:20.570911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:20.571334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:20.714486 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:20.722514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bad3b712-4f55-4a42-a317-70d69d668a18 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.166753 Aug 06 22:17:20.723158 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 397/822] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:20 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:21.744901 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:21.746058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:21.752745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:21.753221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:21.753649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:21.754327 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:21.754774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:21.755191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:21.899103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:21.906977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-92b30012-641a-4530-b5a4-edc7d8d318ed tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.165918 Aug 06 22:17:21.907527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 426/823] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:21 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:22.928793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:22.929402 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:22.935859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:22.936341 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:22.936810 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:22.937491 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:22.937942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:22.938363 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:23.081064 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:23.089697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-154ba9e9-fb6a-4cc9-9139-4358ff78ccf0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.164145 Aug 06 22:17:23.090249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 398/824] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:22 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:24.111301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:24.111905 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:24.118391 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:24.118868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:24.119300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:24.119976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:24.120572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:24.120999 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:24.261526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:24.269473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2def8075-7fb1-4e2f-a4bf-844f9df98a04 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.162001 Aug 06 22:17:24.270031 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 427/825] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:24 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:25.291093 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:25.291700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:25.298987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:25.299470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:25.299903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:25.300642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:25.301096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:25.301542 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:25.446490 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:25.454625 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-439d6f48-c10a-46e5-8d39-733d146355f0 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.167397 Aug 06 22:17:25.455188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 399/826] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:25 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:26.476488 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:26.477091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:26.483447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:26.483919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:26.484348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:26.485084 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:26.485508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:26.485921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:26.633536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:26.641817 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-669ee6d3-8dde-447c-b764-5b3806a18473 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.169416 Aug 06 22:17:26.642385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 428/827] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:26 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:27.662475 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:27.663028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:27.669775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:27.670248 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:27.670680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:27.671365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:27.671814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:27.672233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:27.815773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:27.824582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-26f803e2-2cff-4484-8108-782517cf0844 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.166136 Aug 06 22:17:27.825137 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 400/828] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:27 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:28.845743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:28.846385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:28.853062 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:28.853536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:28.853964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:28.855212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:28.855660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:28.856082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:28.997475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:29.005299 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3f566ebe-8a6f-4e85-8502-d072f46b52d2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.163542 Aug 06 22:17:29.005855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 429/829] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:28 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:30.026731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:30.027288 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:30.033823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:30.034296 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:30.034726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:30.035401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:30.035880 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:30.036267 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:30.177092 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:30.185545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-da906670-7ef3-41ef-a17e-7757ff75d045 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.162913 Aug 06 22:17:30.186100 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 401/830] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:30 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:31.207440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:31.208035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:31.215131 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:31.215600 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:31.216030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:31.216747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:31.217179 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:31.217592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:31.361650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:31.369658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-db1f68d9-fdcb-448f-84be-d524de0c7d11 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1756 microversion: 2.1 time: 0.166469 Aug 06 22:17:31.370804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 430/831] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:31 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:32.390976 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:32.391593 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:32.398012 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:32.398488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:32.398920 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:32.399600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:32.400051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:32.400603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:32.542450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:32.550245 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-dbd57874-8583-4001-be94-91978175b289 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1759 microversion: 2.1 time: 0.163090 Aug 06 22:17:32.550804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 402/832] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:32 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:33.042301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:33.042872 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:33.049331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:33.049809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:33.050237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:33.050912 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:33.051355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:33.051772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:33.074699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lazy-loading 'flavor' on Instance uuid 9bf8ec91-febf-4f9e-a540-08f48c5baae8 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:17:33.416157 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4e93908b-c7ab-46cd-824a-c55e7c0783e8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "POST /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8/action" status: 202 len: 0 microversion: 2.1 time: 0.377646 Aug 06 22:17:33.416850 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 431/833] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:17:33 2022] POST /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:17:33.425180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:33.426059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:33.432492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:33.433213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:33.433645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:33.434334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:33.434781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:33.435195 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:33.568633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:33.576885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5845c311-cfc9-46fc-8368-01aee571b82b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.155535 Aug 06 22:17:33.577456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 403/834] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:33 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:34.599206 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:34.599896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:34.606725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:34.607143 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:34.607570 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:34.608254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:34.608727 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:34.609144 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:34.739004 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:34.747147 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e81947b0-0454-41da-b05f-bde87aa686ed tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.152902 Aug 06 22:17:34.747699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 432/835] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:34 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:35.983857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:35.984506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:35.990400 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:35.990887 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:35.991321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:35.992009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:35.992515 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:35.992941 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:36.125032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:36.132491 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5417490d-8a22-481c-b3ff-c5a9b06bad75 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.367419 Aug 06 22:17:36.134186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 404/836] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:35 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:36.551384 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:36.551947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:36.558972 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:36.559449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:36.559879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:36.560591 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:36.561037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:36.561454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:36.584025 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f4569091-c472-4d44-b1fb-0ae9738857f2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49/ips" status: 200 len: 151 microversion: 2.1 time: 0.036502 Aug 06 22:17:36.584608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 433/837] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:17:36 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:17:36.595984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:36.598398 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:36.605332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:36.605745 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:36.606173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:36.606848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:36.607295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:36.607710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:36.688343 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Invalid volume: volume c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063 is already attached to instances: 56213f38-4e86-47ad-b1df-7734464598ed Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: POST /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49/os-volume_attachments HTTP/1.1 Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 74 Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:17:36.690272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {"volumeAttachment": {"volumeId": "c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063"}} Aug 06 22:17:36.691908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Invalid volume: volume c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063 is already attached to instances: 56213f38-4e86-47ad-b1df-7734464598ed Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'server_id': '590d6f69-cea6-4299-8686-493f521c1e49', 'body': {'volumeAttachment': {'volumeId': 'c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063'}}} Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063 is already attached to instances: 56213f38-4e86-47ad-b1df-7734464598ed Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:36.692842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063 is already attached to instances: 56213f38-4e86-47ad-b1df-7734464598ed Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:36.694063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:17:36.695268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:17:36.695268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:17:36.695268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:17:36.695268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063 is already attached to instances: 56213f38-4e86-47ad-b1df-7734464598ed Aug 06 22:17:36.695268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:36.695268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 400 to user: Invalid volume: volume c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063 is already attached to instances: 56213f38-4e86-47ad-b1df-7734464598ed {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:17:36.695268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-19db53d7-0ae4-4459-8d98-bd25db36d33f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099699 Aug 06 22:17:36.695268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 405/838] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:17:36 2022] POST /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:17:36.700742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:36.701263 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:36.707331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:36.711831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:36.711831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:36.711831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:36.711831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:36.712156 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:36.735684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:17:37.040676 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1db373c3-5aa2-4c56-a7f3-84a6c217155a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 204 len: 0 microversion: 2.1 time: 0.343498 Aug 06 22:17:37.041290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 434/839] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:17:36 2022] DELETE /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:17:37.050254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:37.050869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:37.059148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:37.059632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:37.060069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:37.060793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:37.061275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:37.061703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:37.154015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:37.154737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:37.160632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:37.161115 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:37.161544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:37.162233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:37.162677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:37.163543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:37.195372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:37.203022 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0aafebbc-8819-49f5-8827-d36499c50723 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1681 microversion: 2.1 time: 0.156598 Aug 06 22:17:37.203677 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 406/840] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:37 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:37.293079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:37.300434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-23598485-7983-4ece-8a4e-23d8338a4063 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.150767 Aug 06 22:17:37.300979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 435/841] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:37 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:38.224212 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:38.224892 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:38.231473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:38.231960 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:38.232413 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:38.233140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:38.233596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:38.234023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:38.322222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:38.323449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:38.330060 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:38.330539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:38.330971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:38.331663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:38.332111 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:38.332631 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:38.367190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:38.375507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-807c0f48-a023-4324-9c8e-9eb1de13db69 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1681 microversion: 2.1 time: 0.155429 Aug 06 22:17:38.376395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 407/842] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:38 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:38.462003 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:38.469417 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6fc6dc58-bd33-4ce2-9e61-e44e20770253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.151030 Aug 06 22:17:38.469979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 436/843] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:38 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:39.397633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:39.398279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:39.405153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:39.405646 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:39.406083 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:39.406792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:39.407246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:39.407676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:39.491108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:39.491645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:39.499612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:39.500104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:39.500574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:39.501272 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:39.501776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:39.502136 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:39.563843 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:39.571853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-75f1ad0f-7f30-4ae5-91be-8627d2ac894c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1681 microversion: 2.1 time: 0.178089 Aug 06 22:17:39.572648 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 408/844] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:39 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:39.657399 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:39.664954 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-933aef9e-7701-4830-8edd-eef1290d30ec tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.177753 Aug 06 22:17:39.676745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 437/845] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:39 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:39.841296 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:39.841741 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:39.847681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:39.848170 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:39.848889 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:39.849604 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:39.850059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:39.850488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.033433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2930cde1-e58c-4fd7-9cf5-381591a0cea2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments/1c591658-5c00-4e67-aaf2-612afe6a1f38" status: 200 len: 194 microversion: 2.20 time: 0.196752 Aug 06 22:17:40.034025 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 409/846] 10.222.0.18 () {60 vars in 1454 bytes} [Sat Aug 6 22:17:39 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments/1c591658-5c00-4e67-aaf2-612afe6a1f38 => generated 194 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:17:40.102598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:40.102598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:40.109069 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.109551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.109986 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.110669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.111121 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.111544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.115458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:40.194129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lazy-loading 'services' on Instance uuid 209d7c8e-59b6-4313-a518-a2c8c7eeb290 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:17:40.475189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-f677ef49-eaa4-4e31-ab08-16ccc60129c1 req-4111b4ed-71ef-4aef-a4ec-b4c58dd83d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590d6f69-cea6-4299-8686-493f521c1e49", "name": "network-vif-deleted", "tag": "a8980de9-10ab-47ce-a5c4-88df8a79362e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:40.485198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f677ef49-eaa4-4e31-ab08-16ccc60129c1 req-4111b4ed-71ef-4aef-a4ec-b4c58dd83d2d service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.485659 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f677ef49-eaa4-4e31-ab08-16ccc60129c1 req-4111b4ed-71ef-4aef-a4ec-b4c58dd83d2d service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.486648 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-f677ef49-eaa4-4e31-ab08-16ccc60129c1 req-4111b4ed-71ef-4aef-a4ec-b4c58dd83d2d service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.498105 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0686a42d-28e4-4f14-99b4-a9310e6ba03e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments/1c591658-5c00-4e67-aaf2-612afe6a1f38" status: 202 len: 0 microversion: 2.20 time: 0.400459 Aug 06 22:17:40.502811 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 438/847] 10.222.0.18 () {60 vars in 1457 bytes} [Sat Aug 6 22:17:40 2022] DELETE /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments/1c591658-5c00-4e67-aaf2-612afe6a1f38 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:17:40.507825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:40.509308 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-f677ef49-eaa4-4e31-ab08-16ccc60129c1 req-4111b4ed-71ef-4aef-a4ec-b4c58dd83d2d service nova] Creating event network-vif-deleted:a8980de9-10ab-47ce-a5c4-88df8a79362e for instance 590d6f69-cea6-4299-8686-493f521c1e49 on hv-cinder-84984 Aug 06 22:17:40.511008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:40.516966 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-f677ef49-eaa4-4e31-ab08-16ccc60129c1 req-4111b4ed-71ef-4aef-a4ec-b4c58dd83d2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045338 Aug 06 22:17:40.518226 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 410/848] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:17:40.521212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.521704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.522136 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.522838 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.523282 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.523765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.558043 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8dcea951-fa98-414c-acc9-8f69dbb68f67 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054382 Aug 06 22:17:40.558547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 439/849] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Aug 6 22:17:40 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:17:40.595000 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:40.595688 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:40.602254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.602740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.604493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.605157 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.605646 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.606078 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.678575 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:40.687872 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-72d8ad1b-4076-4c8e-b85e-b38359e45613 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1614 microversion: 2.1 time: 0.097202 Aug 06 22:17:40.688860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 411/850] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:40 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:40.695176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:40.695973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:40.717991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.719971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.719971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.719971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:40.720262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:40.720574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:40.872919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:40.880769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d0437d16-5c8e-4541-b1f9-6c43fa5cf27a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.189388 Aug 06 22:17:40.886400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 440/851] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:40 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:41.570901 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:41.573711 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:41.580372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:41.580898 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:41.581358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:41.582071 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:41.582528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:41.582964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:41.586910 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:41.614991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c70dba69-2b7d-4c70-9041-cb97362907e9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048162 Aug 06 22:17:41.615744 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 412/852] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Aug 6 22:17:41 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:17:41.714241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:41.714958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:41.721535 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:41.722095 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:41.722613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:41.723468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:41.724181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:41.724635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:41.756989 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:41.757496 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:41.757889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:41.758335 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lazy-loading 'fault' on Instance uuid 590d6f69-cea6-4299-8686-493f521c1e49 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:17:41.808843 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:41.826201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-48862b74-27ae-4026-92dd-c917755519dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 200 len: 1330 microversion: 2.1 time: 0.116582 Aug 06 22:17:41.827262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 441/853] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:41 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:41.904962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:41.905677 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:41.912561 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:41.913224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:41.913739 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:41.914621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:41.915126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:41.915548 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:42.068886 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:42.076861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c28fcdfc-41b1-4ea2-bfcb-b1ff265f2f2b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.177479 Aug 06 22:17:42.077467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 413/854] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:41 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:42.627500 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:42.629766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:42.636132 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:42.636702 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:42.637090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:42.637773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:42.638221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:42.638645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:42.667858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f47b135e-088d-4e1f-8448-6d8ec4f50866 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044413 Aug 06 22:17:42.668439 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 442/855] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Aug 6 22:17:42 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:42.734602 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:42.735246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:42.741581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:42.742062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:42.742496 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:42.743176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:42.743633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:42.744050 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:42.769502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:17:42.846995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:42.847633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:42.854359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:42.855183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:42.855297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:42.855965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:42.856429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:42.856862 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:42.870876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 HTTP/1.1 Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:17:42.872742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:17:42.874290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '590d6f69-cea6-4299-8686-493f521c1e49'} Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:17:42.875287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:17:42.876703 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:42.878334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:17:42.878334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1f45610f-44ac-4912-890f-730ad7821b49 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 404 len: 111 microversion: 2.1 time: 0.031010 Aug 06 22:17:42.878334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 443/856] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:42 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 22:17:42.882418 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-29d53f44-cf48-4b1e-b83a-4982a883df3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '.version_select at 0x7f30c68e1b80>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:43.031871 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-29d53f44-cf48-4b1e-b83a-4982a883df3c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212183950" status: 202 len: 0 microversion: 2.1 time: 0.152859 Aug 06 22:17:43.033169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 444/857] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Aug 6 22:17:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212183950 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 22:17:43.099059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:43.099679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:43.106935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:43.108560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:43.108560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:43.109034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:43.109498 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:43.109920 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:43.144206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-643defc5-7ff2-4010-b187-b8114008a120 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 204 len: 0 microversion: 2.20 time: 0.413553 Aug 06 22:17:43.144954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 414/858] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Aug 6 22:17:42 2022] DELETE /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 22:17:43.155899 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:43.156952 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:43.163100 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:43.163722 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:43.168600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:43.168600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:43.168600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:43.168600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:43.296191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:43.303992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7be93620-f8f3-4d23-972a-46046699fa4f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.209359 Aug 06 22:17:43.304573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 445/859] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:43 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:43.340516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:43.356215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:43.357119 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:43.358942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ab0101a2-34ef-4bcd-ac51-3a1b68ba7412 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.207720 Aug 06 22:17:43.359706 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 415/860] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:43 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:17:43.912542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:43.913075 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:43.919510 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:43.919996 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:43.920453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:43.921151 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:43.921606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:43.922033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:44.003053 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lazy-loading 'services' on Instance uuid 56213f38-4e86-47ad-b1df-7734464598ed {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:17:44.216976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0e87bf59-5d27-4685-9e6a-c7cc11cd2fb1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments/c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063" status: 202 len: 0 microversion: 2.1 time: 0.308141 Aug 06 22:17:44.217688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 446/861] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:17:43 2022] DELETE /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments/c2c117b1-a7fa-4e7f-8b77-3ef9c97e9063 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:17:44.226393 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:44.228693 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:44.235324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:44.235801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:44.236243 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:44.237092 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:44.237546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:44.237964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:44.267715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-be4169fc-12fb-4639-9b19-92a35422c87f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045473 Aug 06 22:17:44.268251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 416/862] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:17:44 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:17:44.326015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:44.326717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:44.332925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:44.333410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:44.333844 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:44.334528 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:44.334981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:44.335405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:44.382664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:44.383268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:44.390332 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:44.390744 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:44.391170 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:44.391878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:44.392325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:44.392764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:44.511561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:44.519017 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-56878057-7385-4dbc-878e-87abff5a797d tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.197879 Aug 06 22:17:44.519610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 447/863] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:44 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:44.553372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:44.561679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:44.563167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:44.564303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7e5d3307-658d-4c76-84f0-63c9fa2817f4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.185572 Aug 06 22:17:44.564873 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 417/864] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:44 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:17:45.279366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:45.281666 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:45.287987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:45.288484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:45.288917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:45.289590 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:45.290038 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:45.290451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:45.320429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9a3566e9-a1e9-4acf-b632-3ee605d4630b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045128 Aug 06 22:17:45.320983 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 448/865] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:17:45 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:17:45.540108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:45.540669 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:45.547885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:45.548361 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:45.548833 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:45.549513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:45.549957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:45.550370 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:45.586967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:45.587566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:45.593732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:45.594204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:45.594630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:45.595310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:45.595753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:45.596167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:45.742676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:45.757742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b8de60c9-e38a-4f8e-8318-e8094af8ee48 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.221453 Aug 06 22:17:45.761523 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 418/866] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:45 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:45.768313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:45.776646 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:45.778151 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:45.779307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2b199072-6b7f-4abf-ad20-73b7d74659cf tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.196176 Aug 06 22:17:45.779857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 449/867] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:45 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:17:46.332804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:46.335152 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:46.345190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:46.345685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:46.351950 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:46.352148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:46.352502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:46.353002 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:46.389902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8fb87ab2-ccb5-4761-860d-3376215adaee tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061158 Aug 06 22:17:46.390475 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 419/868] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:17:46 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:17:46.782610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:46.783257 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:46.799747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:46.799747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:46.799747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:46.799747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:46.800055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:46.800055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:46.805376 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:46.806256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:46.814850 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:46.815450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:46.816298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:46.817179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:46.817788 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:46.818374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:47.011406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:47.015033 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:47.019815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-171f55f8-a032-4885-a945-2461da6e97d9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.241017 Aug 06 22:17:47.020435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 450/869] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:46 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:47.023879 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:47.025693 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:47.027124 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-94f48118-4902-41df-8526-3da1a12b07b4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1723 microversion: 2.20 time: 0.228474 Aug 06 22:17:47.027667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 420/870] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:46 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:17:47.401950 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:47.404161 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:47.410060 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:47.410529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:47.410958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:47.411637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:47.412119 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:47.412563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:47.441361 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-30b9c11b-bc4c-4066-a9bd-4339b63953e0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043909 Aug 06 22:17:47.441918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 451/871] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:17:47 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:17:47.503341 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:47.503839 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:47.511364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:47.511364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:47.511710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:47.512433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:47.512915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:47.513339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:47.545063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:17:47.566910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-dc12677b-12aa-4209-97e6-8c8f481c7c99 req-347008de-cd73-48bb-86c2-1b0407b6dbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209d7c8e-59b6-4313-a518-a2c8c7eeb290", "name": "network-vif-deleted", "tag": "608fc1c7-cd79-4b52-883b-01561aed2ea4"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:47.576879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-dc12677b-12aa-4209-97e6-8c8f481c7c99 req-347008de-cd73-48bb-86c2-1b0407b6dbb0 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:47.577360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-dc12677b-12aa-4209-97e6-8c8f481c7c99 req-347008de-cd73-48bb-86c2-1b0407b6dbb0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:47.577791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-dc12677b-12aa-4209-97e6-8c8f481c7c99 req-347008de-cd73-48bb-86c2-1b0407b6dbb0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:47.589791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-dc12677b-12aa-4209-97e6-8c8f481c7c99 req-347008de-cd73-48bb-86c2-1b0407b6dbb0 service nova] Creating event network-vif-deleted:608fc1c7-cd79-4b52-883b-01561aed2ea4 for instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 on hv-cinder-84984 Aug 06 22:17:47.596021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-dc12677b-12aa-4209-97e6-8c8f481c7c99 req-347008de-cd73-48bb-86c2-1b0407b6dbb0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032699 Aug 06 22:17:47.596640 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 452/872] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:17:47.995378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e3a16196-b3fc-4e8c-b8ff-85176c77b93d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 204 len: 0 microversion: 2.1 time: 0.495598 Aug 06 22:17:47.998180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 421/873] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:17:47 2022] DELETE /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:17:48.004965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:48.005660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:48.013007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:48.013427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:48.013855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:48.014537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:48.014984 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:48.015536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:48.043323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:48.044210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:48.050613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:48.051244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:48.051781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:48.052609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:48.053210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:48.053733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:48.209728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:48.218241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5c14df4b-7082-4f8d-aded-b05ca11a88ce tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1680 microversion: 2.1 time: 0.217410 Aug 06 22:17:48.219085 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 453/874] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:47 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:48.223346 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:48.224215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:48.231091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:48.231830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:48.232452 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:48.233332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:48.233790 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:48.234213 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:48.251273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:48.259360 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b436f0bd-eef9-49f8-af30-085510b3924f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.221453 Aug 06 22:17:48.260769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 422/875] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:48 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:48.298131 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:48.306332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:48.308257 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:48.309438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-86a3d9d9-d24c-4ac0-aa92-ef3c4042cacb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1656 microversion: 2.20 time: 0.089710 Aug 06 22:17:48.309983 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 454/876] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:48 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:17:49.240118 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:49.240798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:49.248344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:49.248874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:49.249357 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:49.250106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:49.250612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:49.251062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:49.281753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:49.282565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:49.294927 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:49.295531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:49.298859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:49.299681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:49.300210 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:49.300755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:49.321095 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:49.437847 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:49.444077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6f1a594b-cbcd-4571-9f58-3df143e950d8 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1680 microversion: 2.1 time: 0.207831 Aug 06 22:17:49.444805 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 423/877] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:49 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:49.449264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:49.449873 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:49.452150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:49.456741 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:49.457230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:49.457667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:49.458375 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:49.458825 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:49.459447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:49.477765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:49.487229 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-87c761ff-4006-4bc8-ae63-ddb1df4b1211 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.208887 Aug 06 22:17:49.488011 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 455/878] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:49 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:49.500962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:49.500962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:49.500962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:49.500962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lazy-loading 'fault' on Instance uuid 209d7c8e-59b6-4313-a518-a2c8c7eeb290 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:17:49.544704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:49.553241 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:49.554862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:49.556041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-602c5639-45d0-4ca7-9464-7c70b6345d0f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 200 len: 1370 microversion: 2.20 time: 0.110408 Aug 06 22:17:49.556703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 424/879] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:49 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 1370 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:17:50.468717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:50.470089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:50.474615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:50.480923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:50.481611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:50.482209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:50.483080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:50.483847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:50.484278 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:50.510874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:50.516583 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:50.522965 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:50.523766 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:50.524473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:50.526005 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:50.526842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:50.527535 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:50.532848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:17:50.681968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:50.699622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8e8bc8f4-a708-4f5e-b652-348855dcfc62 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1680 microversion: 2.1 time: 0.231637 Aug 06 22:17:50.699622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 456/880] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:50 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:50.719530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:50.722712 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:50.727738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:50.728190 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:50.728756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:50.729615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:50.730165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:50.730690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:50.741150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:50.747087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] HTTP exception thrown: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Request method failure captured: Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 HTTP/1.1 Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubYc6G-LrYVvxMTTPhkwzVcFU3W6Wuc3EqBK93P811l-jySKL8WQuarmermUCAm3khikjD5Po5aZnU_O6pnObIWiyzrxv-xa1s7l6L4a_ZL-d5WzgH0er05HAyvUftnovm-alayqQYGR9zWP4Iste138Rx0HxgZbcdRvZszP05od4o Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:17:50.749050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e000f22d8284f6ea2178aa17dc70151", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: dfc4de8c76d0470a892dc8bad4d29441 Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:17:50.750815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '209d7c8e-59b6-4313-a518-a2c8c7eeb290'} Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:17:50.751965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:17:50.753637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:17:50.755117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Returning 404 to user: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:17:50.755220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4bd1359e-bf26-452b-b2f9-88037ad6027f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.249001 Aug 06 22:17:50.755569 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-22965e18-63d7-4c82-b7a9-40ea95f5670f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 404 len: 111 microversion: 2.20 time: 0.039598 Aug 06 22:17:50.756312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 425/881] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:50 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:50.756460 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 457/882] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:50 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:17:50.766871 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1f588936-0fa6-476a-ba80-117320794dae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '.version_select at 0x7f30c68939d0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:50.870725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1f588936-0fa6-476a-ba80-117320794dae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834640752" status: 204 len: 0 microversion: 2.20 time: 0.108150 Aug 06 22:17:50.871351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 458/883] 10.222.0.18 () {60 vars in 1259 bytes} [Sat Aug 6 22:17:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834640752 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 22:17:50.984787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-84827333-2270-4eb0-94eb-49b8e8c079c5 req-dfed298c-3528-4058-bb58-ea29d9b47354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56213f38-4e86-47ad-b1df-7734464598ed", "name": "network-vif-deleted", "tag": "bac5d3c4-a8bf-4af4-a8c0-f09c5503cf0f"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:50.996758 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-84827333-2270-4eb0-94eb-49b8e8c079c5 req-dfed298c-3528-4058-bb58-ea29d9b47354 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:51.001450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-84827333-2270-4eb0-94eb-49b8e8c079c5 req-dfed298c-3528-4058-bb58-ea29d9b47354 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:51.001450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-84827333-2270-4eb0-94eb-49b8e8c079c5 req-dfed298c-3528-4058-bb58-ea29d9b47354 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:51.008984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-84827333-2270-4eb0-94eb-49b8e8c079c5 req-dfed298c-3528-4058-bb58-ea29d9b47354 service nova] Creating event network-vif-deleted:bac5d3c4-a8bf-4af4-a8c0-f09c5503cf0f for instance 56213f38-4e86-47ad-b1df-7734464598ed on hv-cinder-84984 Aug 06 22:17:51.014794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-84827333-2270-4eb0-94eb-49b8e8c079c5 req-dfed298c-3528-4058-bb58-ea29d9b47354 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034069 Aug 06 22:17:51.015553 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 426/884] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:17:51.723990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:51.724829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:51.735348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:51.739338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:51.739338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:51.739338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:51.739338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:51.739699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:51.744543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d56f797d-e0f9-4483-9677-6017cfcc4f58 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'create', calling method: .version_select at 0x7f30c6809c10>, body: {"keypair": {"name": "tempest-keypair-1869969858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDG3qHzynk63C14mrmgUQNb4HdIPea+/3hzwxlRnmipUR92r8wxlQSKpDXIZr3aNOWuUwxtFrm7wdSOQWkOpycSutFl1dQiJN23WKYtuuF9gPLiw9+UKVhRB1rOAFmqA=="}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:51.761904 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-d56f797d-e0f9-4483-9677-6017cfcc4f58 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Getting quotas for project 8e000f22d8284f6ea2178aa17dc70151. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:17:51.766297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-d56f797d-e0f9-4483-9677-6017cfcc4f58 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Getting quotas for user dfc4de8c76d0470a892dc8bad4d29441 and project 8e000f22d8284f6ea2178aa17dc70151. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:17:51.774229 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:51.774697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:51.775681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:51.776136 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lazy-loading 'fault' on Instance uuid 56213f38-4e86-47ad-b1df-7734464598ed {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:17:51.821001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:51.831421 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c4a4e61c-05fb-497e-9ed1-8052ea0d0deb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 200 len: 1330 microversion: 2.1 time: 0.109697 Aug 06 22:17:51.831421 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 459/885] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:51 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:51.834668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:51.836593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:51.847394 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:51.848178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:51.849268 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:51.853750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d56f797d-e0f9-4483-9677-6017cfcc4f58 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.113087 Aug 06 22:17:51.854470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 427/886] 10.222.0.18 () {62 vars in 1200 bytes} [Sat Aug 6 22:17:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 06 22:17:51.854921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:51.855494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:51.856110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:52.029395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:52.036946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-09f7082c-041c-4677-aa90-8d713aa2bab0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1507 microversion: 2.1 time: 0.206247 Aug 06 22:17:52.037914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 460/887] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:51 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:52.059461 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:52.060185 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:52.066546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:52.067041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:52.074436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:52.074436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:52.074436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:52.074436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:52.240497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118456) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 22:17:52.602660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b9497547-1c86-46e5-9d32-a9f005c83bcb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "POST /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8/action" status: 202 len: 0 microversion: 2.1 time: 0.548604 Aug 06 22:17:52.603355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 428/888] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:17:52 2022] POST /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 22:17:52.611568 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:52.612166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:52.617991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:52.618470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:52.619395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:52.620172 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:52.620656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:52.621083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:52.776000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:52.783835 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7741e1bb-951c-48b7-866f-e29049e313ef tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1515 microversion: 2.1 time: 0.175973 Aug 06 22:17:52.784428 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 461/889] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:52 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:52.851894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:52.852642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:52.859079 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:52.859576 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:52.860016 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:52.860766 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:52.861182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:52.861605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:52.877713 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed HTTP/1.1 Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:17:52.879365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:17:52.880995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '56213f38-4e86-47ad-b1df-7734464598ed'} Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:17:52.883514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:17:52.891165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:17:52.892454 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:17:52.892454 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-aca560fb-4e06-47d9-890d-da1037c2cd85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 404 len: 111 microversion: 2.1 time: 0.033458 Aug 06 22:17:52.892454 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 429/890] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:52 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:17:52.897044 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3f4395ed-9383-41f5-b076-ccfbf616eed0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '.version_select at 0x7f30c6862790>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:52.976139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3f4395ed-9383-41f5-b076-ccfbf616eed0 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-596356286" status: 202 len: 0 microversion: 2.1 time: 0.080546 Aug 06 22:17:52.976139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 462/891] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Aug 6 22:17:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-596356286 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:17:53.577478 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-57de4d1e-c76d-4727-899f-6dcacf1ab0c3 req-03a71442-5d47-4d45-bdc9-95974e9a4a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf8ec91-febf-4f9e-a540-08f48c5baae8", "name": "network-vif-unplugged", "status": "completed", "tag": "a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:53.587266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-57de4d1e-c76d-4727-899f-6dcacf1ab0c3 req-03a71442-5d47-4d45-bdc9-95974e9a4a0e service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:53.588358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-57de4d1e-c76d-4727-899f-6dcacf1ab0c3 req-03a71442-5d47-4d45-bdc9-95974e9a4a0e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:53.594066 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-57de4d1e-c76d-4727-899f-6dcacf1ab0c3 req-03a71442-5d47-4d45-bdc9-95974e9a4a0e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:53.602603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.compute.server_external_events [req-57de4d1e-c76d-4727-899f-6dcacf1ab0c3 req-03a71442-5d47-4d45-bdc9-95974e9a4a0e service nova] Unable to find a host for instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8. Dropping event network-vif-unplugged {{(pid=118456) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 22:17:53.604236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-57de4d1e-c76d-4727-899f-6dcacf1ab0c3 req-03a71442-5d47-4d45-bdc9-95974e9a4a0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030750 Aug 06 22:17:53.605065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 430/892] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 22:17:53.808083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:53.808728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:53.815056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:53.815427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:53.815864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:53.816592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:53.817048 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:53.817472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:53.819829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-20fbbc4f-0240-404f-80d0-f09c08a50aa4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: .version_select at 0x7f30c6953940>, body: {"keypair": {"name": "tempest-keypair-446120663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDE4Q2Tb5MnIDEhyfIRrstqWaX/A2PyZuSzOkhUjZQxgsertBGvGxMeiX0G6cCgjG73VHyU/fSTo2iGTNffPIhArGot6/9Mgrg/SfTjqtgpXHmMdAjc9UUtAXatKsFAcQ=="}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:53.843306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-20fbbc4f-0240-404f-80d0-f09c08a50aa4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for project f4867885fc0d4ca29d2d674465398466. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:17:53.847255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-20fbbc4f-0240-404f-80d0-f09c08a50aa4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for user 0d6e35038fed4b44b986902a5ef55ce8 and project f4867885fc0d4ca29d2d674465398466. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:17:53.974100 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-20fbbc4f-0240-404f-80d0-f09c08a50aa4 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157758 Aug 06 22:17:53.979707 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 431/893] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:17:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:17:54.045946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:54.053715 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a57ee6cf-2149-4d9b-9d53-41a75a16ad95 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1515 microversion: 2.1 time: 0.251153 Aug 06 22:17:54.054286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 463/894] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:53 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:54.654358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-766734802", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e88b6eb-9927-4041-97fb-cf4152442c9e"}], "security_groups": [{"name": "tempest-securitygroup--348862650"}], "key_name": "tempest-keypair-1869969858", "user_data": "}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:54.764639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] validate_networks() for [('8e88b6eb-9927-4041-97fb-cf4152442c9e', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:17:55.116444 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08378591-704d-4cd6-95d0-c367a56e4c91"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:55.120240 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:55.126551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:55.127033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:55.130521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:55.130521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:55.130521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:55.130521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:55.149302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:17:55.149905 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:17:55.150915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:17:55.151323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:17:55.151732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:17:55.166333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:55.167046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:55.167776 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:55.168642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:55.169194 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:55.169724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:55.188664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Getting quotas for project 8e000f22d8284f6ea2178aa17dc70151. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:17:55.192643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Getting quotas for user dfc4de8c76d0470a892dc8bad4d29441 and project 8e000f22d8284f6ea2178aa17dc70151. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:17:55.204566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:17:55.206821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:17:55.317091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-91db0b6c-8d5e-4438-83bc-fa3d42a5095e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.667702 Aug 06 22:17:55.317721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 432/895] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Aug 6 22:17:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 22:17:55.323147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:55.323962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:55.330758 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:55.331453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:55.332040 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:55.332937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:55.333384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:55.333988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:55.592103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:55.600101 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ee93bba7-cbc2-48f4-b7d0-8b318f427d2f tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1517 microversion: 2.1 time: 0.281230 Aug 06 22:17:55.604790 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 433/896] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:55 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:55.605683 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c1465228-a7f5-4b24-b6c1-df8ae631e0da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:55.606297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c1465228-a7f5-4b24-b6c1-df8ae631e0da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:55.912989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c1465228-a7f5-4b24-b6c1-df8ae631e0da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:55.921251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c1465228-a7f5-4b24-b6c1-df8ae631e0da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:55.922865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c1465228-a7f5-4b24-b6c1-df8ae631e0da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:55.924278 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c1465228-a7f5-4b24-b6c1-df8ae631e0da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1281 microversion: 2.20 time: 0.322551 Aug 06 22:17:55.924963 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 434/897] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:55 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1281 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:17:55.995015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7bf617e4-37e9-4551-bc07-52fe88786277 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.001175 Aug 06 22:17:55.995628 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 464/898] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:17:54 2022] POST /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments => generated 194 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:17:56.624971 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:56.625751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:56.637734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:56.638175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:56.638612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:56.639309 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:56.639762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:56.640182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:56.797535 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:56.805809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-dca44751-971c-41e3-986d-42dfd024e74b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.186281 Aug 06 22:17:56.807080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 435/899] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:56 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:56.878626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-786271166", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15a3ad5d-cae3-43a4-b19f-06f85bc9b5e1"}], "security_groups": [{"name": "tempest-securitygroup--754150567"}], "key_name": "tempest-keypair-446120663", "user_data": "}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:17:56.948187 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:56.949365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:56.957340 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:56.958111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:56.958540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:56.959461 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:56.960067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:56.960656 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:56.991945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] validate_networks() for [('15a3ad5d-cae3-43a4-b19f-06f85bc9b5e1', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:17:57.077514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:57.093462 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:57.095813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:57.096956 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2596b028-fa28-4eeb-a2ab-a66882a2e1a4 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1333 microversion: 2.20 time: 0.153580 Aug 06 22:17:57.097504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 436/900] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:56 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1333 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:17:57.456220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:17:57.456671 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:17:57.457169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:17:57.457571 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:17:57.457975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:17:57.466755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:57.467229 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:57.467658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:57.468397 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:57.468877 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:57.469291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:57.486321 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for project f4867885fc0d4ca29d2d674465398466. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:17:57.490218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for user 0d6e35038fed4b44b986902a5ef55ce8 and project f4867885fc0d4ca29d2d674465398466. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:17:57.501559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:17:57.503792 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:17:57.653840 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bdf55e0f-291e-46de-a1f7-e99319228897 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.779757 Aug 06 22:17:57.654523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 465/901] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:17:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:17:57.665932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5a3c64af-3c95-4874-886e-2281f036c472 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:57.666809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5a3c64af-3c95-4874-886e-2281f036c472 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:57.720336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5a3c64af-3c95-4874-886e-2281f036c472 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:57.729748 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5a3c64af-3c95-4874-886e-2281f036c472 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1240 microversion: 2.1 time: 0.068207 Aug 06 22:17:57.730406 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 437/902] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:57 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:57.827394 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:57.828019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:57.834290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:57.834776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:57.839839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:57.839839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:57.839839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:57.839839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:57.970508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:57.978885 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-817a6638-958d-42be-bdfe-253b70e184d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.155483 Aug 06 22:17:57.979451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 466/903] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:57 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:58.121327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:58.121932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:58.128235 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:58.128751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:58.129179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:58.129859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:58.130307 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:58.130727 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:58.198040 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:58.206394 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:58.207920 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:58.209067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-92ba7db5-50cf-46c2-b1c1-95dfea821495 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1333 microversion: 2.20 time: 0.091751 Aug 06 22:17:58.209798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 438/904] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:58 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:17:58.750774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:58.751743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:58.757769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:58.758562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:58.759809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:58.761005 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:58.761177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:58.761840 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:58.828425 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:58.836064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5ce72dc2-e231-458b-b345-1a88e2b9715c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1244 microversion: 2.1 time: 0.089250 Aug 06 22:17:58.836662 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 467/905] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:58 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:17:59.008017 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:59.009138 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:59.016256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:59.016841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:59.017346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:59.018128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:59.018612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:59.019034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:59.168461 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:59.176391 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6eb151dd-182b-4a40-b519-e0e7a9ff1c69 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.173278 Aug 06 22:17:59.177181 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 439/906] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:59 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:17:59.233025 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:59.233642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:59.242660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:59.243154 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:59.243841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:59.244688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:59.245438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:59.245879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:59.309791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:59.317770 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:59.319293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:59.320388 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-74339d7a-71b4-4be1-b240-98989132f7a2 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1339 microversion: 2.20 time: 0.092156 Aug 06 22:17:59.320964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 468/907] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:17:59 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1339 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:17:59.857299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:17:59.858065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:17:59.864155 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:59.864703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:59.865133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:59.865839 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:17:59.866451 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:17:59.866857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:17:59.938153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:17:59.946295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-78e94c3a-8b47-4e66-95f4-b77d66d9b8bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1300 microversion: 2.1 time: 0.092240 Aug 06 22:17:59.946295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 440/908] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:17:59 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:00.199000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:00.199983 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:00.207823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:00.208469 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:00.209765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:00.212066 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:00.212066 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:00.212066 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:00.343146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:00.343778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:00.355481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:00.355971 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:00.356427 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:00.357601 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:00.358063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:00.358671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:00.386033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:00.398001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-eee76a8f-505a-4df1-9a1a-2ad154e6aba8 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.203305 Aug 06 22:18:00.398786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 469/909] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:00 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:00.504739 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:00.513473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:00.519907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:00.519907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d00ad8e0-ed15-46a6-8d3a-9343333b4297 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.176953 Aug 06 22:18:00.519907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 441/910] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:00 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:18:00.714919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-3234eedc-4319-4818-95b2-a85840b98995 req-60f3f4fd-52d9-42f5-b664-a9d3958c2786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d13c88b-ec4a-4fc4-af59-8fe95949327f", "tag": "69af86b5-7845-4fb4-ad57-44fa19c640b3"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:00.724970 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-3234eedc-4319-4818-95b2-a85840b98995 req-60f3f4fd-52d9-42f5-b664-a9d3958c2786 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:00.725424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-3234eedc-4319-4818-95b2-a85840b98995 req-60f3f4fd-52d9-42f5-b664-a9d3958c2786 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:00.725845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-3234eedc-4319-4818-95b2-a85840b98995 req-60f3f4fd-52d9-42f5-b664-a9d3958c2786 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:00.739713 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-3234eedc-4319-4818-95b2-a85840b98995 req-60f3f4fd-52d9-42f5-b664-a9d3958c2786 service nova] Creating event network-changed:69af86b5-7845-4fb4-ad57-44fa19c640b3 for instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f on hv-cinder-84984 Aug 06 22:18:00.744709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-3234eedc-4319-4818-95b2-a85840b98995 req-60f3f4fd-52d9-42f5-b664-a9d3958c2786 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034265 Aug 06 22:18:00.745750 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 470/911] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:00.967600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:00.968215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:00.974652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:00.975210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:00.975716 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:00.976525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:00.976997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:00.977418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:01.040334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:01.048223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5d9994a4-b087-4176-8043-ce2626d098ab tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1298 microversion: 2.1 time: 0.084446 Aug 06 22:18:01.049013 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 442/912] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:00 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:01.424523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:01.425322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:01.433613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:01.434091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:01.434517 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:01.435202 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:01.435643 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:01.436056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:01.543383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:01.544169 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:01.553831 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:01.559470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:01.559470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:01.559470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:01.559470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:01.559925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:01.807535 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:01.815030 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:01.817349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:01.818865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:01.819992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e4d3b441-1058-48d2-9275-59c864908672 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.281620 Aug 06 22:18:01.820799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 443/913] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:01 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:18:01.825019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f5bc7de7-5612-47b5-b111-de911dc3bd28 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.409539 Aug 06 22:18:01.836526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 471/914] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:01 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:02.069257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:02.069787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:02.075751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:02.076235 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:02.076703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:02.077398 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:02.077877 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:02.078299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:02.207429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:02.216160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7acbbe46-662f-40b4-8fc1-617f196fc676 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.150613 Aug 06 22:18:02.216612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 444/915] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:02 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:02.760970 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-a1ae01b1-cf3b-4af8-b809-61db0e1bf63b req-573a5e5a-7f64-4a20-aae6-ba83597535eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317f93e1-fb8d-4630-aa61-d3232597ddf9", "tag": "6f569b4a-6fb6-4035-9912-48a14554f341"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:02.770455 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-a1ae01b1-cf3b-4af8-b809-61db0e1bf63b req-573a5e5a-7f64-4a20-aae6-ba83597535eb service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:02.770920 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-a1ae01b1-cf3b-4af8-b809-61db0e1bf63b req-573a5e5a-7f64-4a20-aae6-ba83597535eb service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:02.771350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-a1ae01b1-cf3b-4af8-b809-61db0e1bf63b req-573a5e5a-7f64-4a20-aae6-ba83597535eb service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:02.781684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-a1ae01b1-cf3b-4af8-b809-61db0e1bf63b req-573a5e5a-7f64-4a20-aae6-ba83597535eb service nova] Creating event network-changed:6f569b4a-6fb6-4035-9912-48a14554f341 for instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 on hv-cinder-84984 Aug 06 22:18:02.786475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-a1ae01b1-cf3b-4af8-b809-61db0e1bf63b req-573a5e5a-7f64-4a20-aae6-ba83597535eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029136 Aug 06 22:18:02.787083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 472/916] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:02.842112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:02.842716 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:02.849243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:02.849444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:02.849921 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:02.850022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:02.850347 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:02.851039 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:02.851487 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:02.851911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:02.856451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:02.856930 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:02.857357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:02.858036 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:02.858478 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:02.858894 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:03.046121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:03.054307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:03.054490 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:03.055929 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:03.057354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6d1b77c8-431d-422d-9a98-031f34a6a2de tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.219099 Aug 06 22:18:03.060256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 445/917] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:02 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:03.062623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-03c6a379-ea6b-406a-aab2-f9898063c4b0 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.217664 Aug 06 22:18:03.063257 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 473/918] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:02 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:18:03.237756 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:03.238365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:03.244307 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:03.244865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:03.245303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:03.245986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:03.246437 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:03.246860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:03.372428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:03.379885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9f5aed97-0d3e-4285-b10d-1400638e7b8e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.145990 Aug 06 22:18:03.380473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 446/919] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:03 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:04.079178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:04.079818 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:04.082804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:04.083413 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:04.086391 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:04.086863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:04.089974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:04.089974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:04.089974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:04.089974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:04.090346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:04.090827 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:04.091262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:04.091954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:04.092419 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:04.092846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:04.111681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:04.286632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:04.290246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:04.295867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:04.297497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:04.298276 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-69070b84-73d3-460f-899d-dfe07c2deeb2 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.219206 Aug 06 22:18:04.298598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c4cc9a3e-79f5-4c72-8e27-91eed9853fc8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.223407 Aug 06 22:18:04.298838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 447/920] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:04 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:18:04.299144 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 474/921] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:04 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:18:04.401262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:04.401882 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:04.407767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:04.408242 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:04.408710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:04.409396 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:04.409848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:04.410271 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:04.543947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:04.557710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-21edf631-cb43-432b-b2e7-1e5312e4c65c tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.154656 Aug 06 22:18:04.557710 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 448/922] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:04 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:05.320103 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:05.320739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:05.322719 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:05.323328 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:05.326779 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:05.327837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:05.328320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:05.328876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:05.329477 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:05.329937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:05.330319 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:05.330437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:05.330800 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:05.331230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:05.331922 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:05.332374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:05.332820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:05.335624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:05.532723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:05.539792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:05.542371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-50acb2b8-b1c7-4f7f-8f01-65b7031bb0e5 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.225929 Aug 06 22:18:05.543059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 475/923] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:05 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:05.549312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:05.550822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:05.551933 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-928f935a-1d5c-483b-9b3f-b2ebba280939 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.233729 Aug 06 22:18:05.552490 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 449/924] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:05 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:18:05.573196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:05.573728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:05.580083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:05.580620 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:05.581077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:05.587082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:05.587082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:05.587082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:05.715088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:05.722439 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2f8152da-65a2-4de9-afd9-0141a28ca4bc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.153750 Aug 06 22:18:05.722994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 476/925] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:05 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:06.564499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:06.565142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:06.568790 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:06.575322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:06.576061 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:06.582655 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:06.582988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:06.583124 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:06.583480 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:06.583606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:06.583914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:06.584232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:06.584646 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:06.585041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:06.585211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:06.585460 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:06.585622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:06.788472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:06.793049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:06.796737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-54791c8d-fbaf-4937-b79b-e235ed63ffee tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.236427 Aug 06 22:18:06.797310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 450/926] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:06 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:06.801102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:06.801888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:06.802500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:06.802624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:06.803672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8f9c847f-b720-4a31-add6-b831a34869c1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.232306 Aug 06 22:18:06.804378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 477/927] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:06 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:06.809352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:06.809840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:06.810275 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:06.810968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:06.811424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:06.811849 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:06.938277 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:06.945652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0d3d636b-b568-4461-99f2-9cfe686709b6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.147409 Aug 06 22:18:06.946218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 451/928] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:06 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:07.816125 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:07.821618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:07.823989 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:07.824786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=6 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:07.827295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:07.827906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:07.830432 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=18 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:07.830952 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:07.831448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:07.832908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:07.833299 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:07.833756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:07.834340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:07.835236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:07.835719 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:07.836152 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:07.837188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:07.837645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:07.839366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:07.858935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lazy-loading 'flavor' on Instance uuid 52d2f2af-bc41-42c1-9546-a62b80daea75 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:18:07.990685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:07.999075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9df1fe11-212d-4fbe-9b83-59f6439bd009 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.176138 Aug 06 22:18:07.999624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 452/929] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:07 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:08.005029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:08.006006 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:08.012106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:08.015628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:08.015628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:08.015628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:08.015628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:08.016024 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:08.146504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:08.155158 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:08.156698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:08.157884 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-76d03863-06a6-4a70-b795-2563996bd987 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.157277 Aug 06 22:18:08.158483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 453/930] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:07 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:08.163150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-e863a9c3-6caf-444e-8537-c460f8e3ea65 req-af584ba0-4802-4ac8-a50e-2034ff24ee00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d13c88b-ec4a-4fc4-af59-8fe95949327f", "name": "network-vif-plugged", "status": "completed", "tag": "69af86b5-7845-4fb4-ad57-44fa19c640b3"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:08.173465 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e863a9c3-6caf-444e-8537-c460f8e3ea65 req-af584ba0-4802-4ac8-a50e-2034ff24ee00 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:08.173936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e863a9c3-6caf-444e-8537-c460f8e3ea65 req-af584ba0-4802-4ac8-a50e-2034ff24ee00 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:08.174417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e863a9c3-6caf-444e-8537-c460f8e3ea65 req-af584ba0-4802-4ac8-a50e-2034ff24ee00 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:08.185269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-e863a9c3-6caf-444e-8537-c460f8e3ea65 req-af584ba0-4802-4ac8-a50e-2034ff24ee00 service nova] Creating event network-vif-plugged:69af86b5-7845-4fb4-ad57-44fa19c640b3 for instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f on hv-cinder-84984 Aug 06 22:18:08.190357 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-e863a9c3-6caf-444e-8537-c460f8e3ea65 req-af584ba0-4802-4ac8-a50e-2034ff24ee00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Aug 06 22:18:08.190936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 454/931] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:08.195767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:08.196511 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:08.202386 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:08.202865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:08.203349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:08.204030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:08.204507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:08.204934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:08.209652 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d1b90117-97bf-4840-adaf-eab5967a1b72 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/action" status: 200 len: 32 microversion: 2.1 time: 0.397631 Aug 06 22:18:08.210309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 478/932] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:18:07 2022] POST /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/action => generated 32 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:18:08.220385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:08.221089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:08.227464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:08.227989 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:08.228946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:08.229624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:08.230070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:08.230486 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:08.423859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:08.428359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:08.432867 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-739fa6f9-d6de-40d7-8447-84bd84bca823 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.240499 Aug 06 22:18:08.433458 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 455/933] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:08 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:08.438357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f0fd7781-0600-4638-8d1a-88e4ff3a1892 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.221798 Aug 06 22:18:08.439191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 479/934] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:08 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:18:09.020361 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:09.021001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:09.027841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:09.028314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:09.028765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:09.029447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:09.029891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:09.030304 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:09.163314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:09.171420 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-82edd1de-6042-4634-898d-d928a5f5686a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.154873 Aug 06 22:18:09.171978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 456/935] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:09 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:09.180742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:09.181773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:09.188229 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:09.188774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:09.189213 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:09.189904 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:09.190387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:09.190810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:09.316824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:09.325358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:09.326855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:09.327961 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8680035a-336f-4bfe-a82f-cac128570e14 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.151160 Aug 06 22:18:09.328531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 480/936] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:09 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:09.454023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:09.454686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:09.459995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:09.460627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:09.461116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:09.461590 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:09.462028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:09.463289 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:09.463735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:09.464148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:09.467361 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:09.467846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:09.468274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:09.468978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:09.469425 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:09.469839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:09.653657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:09.660584 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:09.661001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ced28ad5-3bf5-400a-ae8d-3be3e412a1a2 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.210783 Aug 06 22:18:09.661598 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 457/937] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:09 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:09.669293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1c43bffe-ff98-49ba-acdd-74328e0521ad tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.213051 Aug 06 22:18:09.669931 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 481/938] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:09 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:18:10.191741 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:10.192352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:10.198870 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.199352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.199822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.200578 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.201030 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.201452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.204911 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-99eca440-fc08-4300-974f-2718eaf02186 req-10fd998b-5164-4812-9765-b44df8bc5d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf8ec91-febf-4f9e-a540-08f48c5baae8", "name": "network-vif-plugged", "status": "completed", "tag": "a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:10.214946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-99eca440-fc08-4300-974f-2718eaf02186 req-10fd998b-5164-4812-9765-b44df8bc5d86 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.215419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-99eca440-fc08-4300-974f-2718eaf02186 req-10fd998b-5164-4812-9765-b44df8bc5d86 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.216162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-99eca440-fc08-4300-974f-2718eaf02186 req-10fd998b-5164-4812-9765-b44df8bc5d86 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.228244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-99eca440-fc08-4300-974f-2718eaf02186 req-10fd998b-5164-4812-9765-b44df8bc5d86 service nova] Creating event network-vif-plugged:a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e for instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 on hv-cinder-84984 Aug 06 22:18:10.233307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-99eca440-fc08-4300-974f-2718eaf02186 req-10fd998b-5164-4812-9765-b44df8bc5d86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032063 Aug 06 22:18:10.233905 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 482/939] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:18:10.338324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:10.350397 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3c8dc7c2-ec97-40fb-ac38-d0c08b5bc5e9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.162464 Aug 06 22:18:10.351616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 458/940] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:10 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:10.362730 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:10.363806 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:10.371661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.372140 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.372610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.373332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.373953 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.374371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.511015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:10.519432 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:10.520965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:10.522068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4bbc83b1-fbfb-4c3f-b5d6-b3d82c1ca889 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.167976 Aug 06 22:18:10.522612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 483/941] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:10 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:10.682728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:10.683382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:10.689464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.689947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.690492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.691189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.691764 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.692192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.693803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:10.694426 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:10.700750 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.701231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.707714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.707714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:10.707714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:10.707714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:10.899102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:10.907369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ab592825-ac44-4252-96f0-aa999e392f12 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.229053 Aug 06 22:18:10.907953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 459/942] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:10 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:10.909518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:10.917874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a455d767-9728-40db-8cc1-e1b176eaf07b tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.228122 Aug 06 22:18:10.918593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 484/943] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:10 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:11.374619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:11.375228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:11.381897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:11.382374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:11.382804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:11.383485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:11.384723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:11.385150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:11.512153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:11.519568 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b110d995-8a52-464e-b81d-eb6baaa05a84 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.148829 Aug 06 22:18:11.520119 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 460/944] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:11 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:11.545569 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:11.546200 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:11.552461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:11.552968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:11.553412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:11.554087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:11.554529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:11.554941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:11.684798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:11.692771 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:11.694292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:11.695421 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-dc652112-2a5c-4863-bd66-ad277498a4b1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.153937 Aug 06 22:18:11.695970 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 485/945] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:11 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:11.927183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:11.927798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:11.934251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:11.934685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:11.935043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:11.935750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:11.936190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:11.936628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:11.938996 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:11.939609 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:11.945458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:11.949416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:11.949416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:11.949416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:11.949416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:11.949861 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:12.131739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:12.135146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:12.140586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c06ab1c7-d92c-4512-9d5f-332033d50739 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.205586 Aug 06 22:18:12.141416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 486/946] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:11 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:18:12.142770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2d28dd29-ea03-45f4-a292-dc5b250da964 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.219489 Aug 06 22:18:12.143334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 461/947] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:11 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:12.540468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:12.541070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:12.546954 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:12.547528 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:12.547872 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:12.548571 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:12.549017 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:12.549432 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:12.685725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:12.693159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-604cc69b-ac8a-4c12-8202-3a96cf001999 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1573 microversion: 2.1 time: 0.156535 Aug 06 22:18:12.693720 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 487/948] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:12 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:12.718110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:12.718817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:12.725145 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:12.725692 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:12.734366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:12.734366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:12.734366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:12.734366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:12.854805 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:12.862791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:12.864302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:12.865433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2b6fb3e8-72b3-48cf-8746-44ab3169afc7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.151245 Aug 06 22:18:12.865986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 462/949] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:12 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:13.162947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:13.163551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:13.163749 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:13.164371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:13.169684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:13.170172 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:13.170611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:13.170846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:13.171308 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:13.171423 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:13.171766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:13.172188 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:13.172382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:13.173166 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:13.173572 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:13.174027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:13.371530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:13.380158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-942b9d40-fb40-4a60-b18b-2c7d79dac8d5 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.221008 Aug 06 22:18:13.381031 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 488/950] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:13 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:13.382357 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:13.392036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-49c9a17f-168d-441b-bd30-704ce7a1bcfe tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.232162 Aug 06 22:18:13.392778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 463/951] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:13 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:18:13.717189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:13.717803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:13.724532 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:13.725015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:13.725458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:13.726150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:13.726602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:13.727024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:13.867092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:13.875731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-96db6845-bb80-4e0b-883d-161b5110aad9 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1560 microversion: 2.1 time: 0.166066 Aug 06 22:18:13.876298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 489/952] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:13 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:13.887092 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:13.887702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:13.893835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:13.894310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:13.895004 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:13.895699 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:13.896151 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:13.896600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:14.016048 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-4d60bdfc-9f9f-44da-83be-8bad1806d493 req-c3d32b46-a990-41d3-893a-68bc1a7da24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317f93e1-fb8d-4630-aa61-d3232597ddf9", "name": "network-vif-plugged", "status": "completed", "tag": "6f569b4a-6fb6-4035-9912-48a14554f341"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:14.025807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-4d60bdfc-9f9f-44da-83be-8bad1806d493 req-c3d32b46-a990-41d3-893a-68bc1a7da24e service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:14.026593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-4d60bdfc-9f9f-44da-83be-8bad1806d493 req-c3d32b46-a990-41d3-893a-68bc1a7da24e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:14.027248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-4d60bdfc-9f9f-44da-83be-8bad1806d493 req-c3d32b46-a990-41d3-893a-68bc1a7da24e service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:14.037820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:14.039246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-4d60bdfc-9f9f-44da-83be-8bad1806d493 req-c3d32b46-a990-41d3-893a-68bc1a7da24e service nova] Creating event network-vif-plugged:6f569b4a-6fb6-4035-9912-48a14554f341 for instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 on hv-cinder-84984 Aug 06 22:18:14.041971 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:14.044918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-4d60bdfc-9f9f-44da-83be-8bad1806d493 req-c3d32b46-a990-41d3-893a-68bc1a7da24e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Aug 06 22:18:14.045677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 490/953] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:14.049059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:14.049750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:14.050847 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d645d2c5-b85c-4dfa-b274-4366c8c1e974 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1406 microversion: 2.20 time: 0.167761 Aug 06 22:18:14.051381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 464/954] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:13 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:14.404102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:14.404840 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:14.411053 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:14.411542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:14.411984 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:14.412705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:14.413165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:14.413398 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:14.413588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:14.414025 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:14.419859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:14.421911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:14.422378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:14.422815 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:14.423514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:14.423969 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:14.424421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:14.609591 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:14.612728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:14.617802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-87d433f5-8376-45b3-966e-cce2137c437d tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.218629 Aug 06 22:18:14.618834 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 491/955] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:14 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:14.620157 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8ca7be1c-865d-4168-af24-59592785f35d tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.211295 Aug 06 22:18:14.620753 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 465/956] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:14 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:15.074933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:15.075573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:15.082016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:15.082494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:15.082925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:15.083611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:15.084063 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:15.084513 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:15.210182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:15.218047 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:15.219547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:15.220723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ad392ce7-3315-4429-83c6-e2ca05bef6d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1598 microversion: 2.20 time: 0.150506 Aug 06 22:18:15.221269 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 492/957] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:18:15 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:18:15.242677 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:15.243676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:15.249632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:15.250109 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:15.250537 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:15.251211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:15.251658 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:15.252074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:15.330560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-527c17a5-4465-4fcb-a749-40baaec08a05 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091766 Aug 06 22:18:15.331146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 466/958] 10.222.0.18 () {60 vars in 1316 bytes} [Sat Aug 6 22:18:15 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:18:15.639413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:15.639949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:15.646360 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:15.647184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:15.657582 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:15.659985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:15.660691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:15.661310 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:15.661947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:15.662833 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:15.663420 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:15.664280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:15.665721 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:15.666516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:15.669318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:15.669771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:16.240342 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:16.243010 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:16.248685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-92f8f41b-b656-45dc-9a5a-1db70a07ca87 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1365 microversion: 2.1 time: 0.605916 Aug 06 22:18:16.249343 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 467/959] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:15 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1365 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:16.254082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b6ab7d2f-6124-4fed-8f6c-7ebeeb84d1e9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.618598 Aug 06 22:18:16.254789 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 493/960] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:15 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:16.712140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-320eeeff-f47c-4696-8d39-c59c60e49da8 req-6fc78f87-34b7-4e60-9913-e01516e2b38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d13c88b-ec4a-4fc4-af59-8fe95949327f", "tag": "69af86b5-7845-4fb4-ad57-44fa19c640b3"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:16.721475 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-320eeeff-f47c-4696-8d39-c59c60e49da8 req-6fc78f87-34b7-4e60-9913-e01516e2b38b service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:16.721944 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-320eeeff-f47c-4696-8d39-c59c60e49da8 req-6fc78f87-34b7-4e60-9913-e01516e2b38b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:16.722372 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-320eeeff-f47c-4696-8d39-c59c60e49da8 req-6fc78f87-34b7-4e60-9913-e01516e2b38b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:16.733700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-320eeeff-f47c-4696-8d39-c59c60e49da8 req-6fc78f87-34b7-4e60-9913-e01516e2b38b service nova] Creating event network-changed:69af86b5-7845-4fb4-ad57-44fa19c640b3 for instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f on hv-cinder-84984 Aug 06 22:18:16.738665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-320eeeff-f47c-4696-8d39-c59c60e49da8 req-6fc78f87-34b7-4e60-9913-e01516e2b38b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091218 Aug 06 22:18:16.739240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 468/961] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:17.270095 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:17.271303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:17.279650 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:17.280234 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:17.280698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:17.281381 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:17.282098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:17.282539 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:17.287208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:17.287208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:17.296676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:17.297580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:17.299066 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:17.300568 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:17.301313 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:17.301969 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:17.508168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:17.516344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:17.519348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0b878ad3-5e89-4ebe-b9c9-c434f3f98f03 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1556 microversion: 2.1 time: 0.253003 Aug 06 22:18:17.520876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 494/962] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:17 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:17.524833 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-37c505aa-0ab5-4d0a-a462-88cfa638e84e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.252947 Aug 06 22:18:17.525969 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 469/963] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:17 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:17.555153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:17.556673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:17.562773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:17.563393 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:17.563922 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:17.564750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:17.565300 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:17.565822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:17.652272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9b8384c3-ec22-46fa-bbd5-e783f89fb3df tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100990 Aug 06 22:18:17.652917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 470/964] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Aug 6 22:18:17 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:18.555771 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:18.556598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:18.559073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:18.564273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:18.564799 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:18.565276 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:18.565942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:18.566390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:18.566807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:18.790588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:18.798202 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-2580b6b0-5ac9-415d-b25c-69b784bfd105 req-ad41a58a-c4e4-44f4-b9f8-2c4f2fc729c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317f93e1-fb8d-4630-aa61-d3232597ddf9", "tag": "6f569b4a-6fb6-4035-9912-48a14554f341"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:18.802655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7bec4cd9-787d-4b6d-9442-30d8f2f3a155 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.247577 Aug 06 22:18:18.802655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 495/965] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:18 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:18.808201 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2580b6b0-5ac9-415d-b25c-69b784bfd105 req-ad41a58a-c4e4-44f4-b9f8-2c4f2fc729c0 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:18.808713 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2580b6b0-5ac9-415d-b25c-69b784bfd105 req-ad41a58a-c4e4-44f4-b9f8-2c4f2fc729c0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:18.809142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2580b6b0-5ac9-415d-b25c-69b784bfd105 req-ad41a58a-c4e4-44f4-b9f8-2c4f2fc729c0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:18.820249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-2580b6b0-5ac9-415d-b25c-69b784bfd105 req-ad41a58a-c4e4-44f4-b9f8-2c4f2fc729c0 service nova] Creating event network-changed:6f569b4a-6fb6-4035-9912-48a14554f341 for instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 on hv-cinder-84984 Aug 06 22:18:18.825958 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-2580b6b0-5ac9-415d-b25c-69b784bfd105 req-ad41a58a-c4e4-44f4-b9f8-2c4f2fc729c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Aug 06 22:18:18.826549 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 471/966] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:19.826318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:19.826318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:19.830758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:19.831273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:19.831714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:19.832489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:19.833128 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:19.833558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:19.965586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:19.973883 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0606a7bd-fb30-4d63-bd98-910e03ea55ec tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.155180 Aug 06 22:18:19.974440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 496/967] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:19 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:20.996345 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:20.997069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:21.003222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:21.003709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:21.004142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:21.004857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:21.005316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:21.005740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:21.137570 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:21.145497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c47fb056-8edd-4c74-ab7e-7e9bf0c54049 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.154093 Aug 06 22:18:21.146156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 472/968] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:20 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:22.167718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:22.168267 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:22.174837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:22.175322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:22.175764 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:22.176484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:22.176944 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:22.177371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:22.304711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:22.313215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-354b7882-8402-4837-afda-6fa070778d1e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.150078 Aug 06 22:18:22.313778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 497/969] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:22 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:23.334466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:23.335077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:23.341896 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:23.342376 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:23.342810 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:23.343493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:23.343948 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:23.344370 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:23.470196 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:23.478986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9f62fe66-5606-4350-a507-49cf888531b1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.148389 Aug 06 22:18:23.479566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 473/970] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:23 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:24.499995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:24.500638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:24.507057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:24.507537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:24.507974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:24.508691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:24.509864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:24.510291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:24.640758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:24.648598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-52f6cf55-7f83-4c0c-8ab3-8ee6b4cb9869 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.152573 Aug 06 22:18:24.649156 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 498/971] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:24 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:25.670007 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:25.670569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:25.677071 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:25.677546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:25.677978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:25.678656 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:25.679101 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:25.679520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:25.807878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:25.815959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bae9798c-628c-4ec5-8977-4d9f2bfafebe tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.149919 Aug 06 22:18:25.816551 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 474/972] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:25 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:26.837626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:26.838225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:26.845256 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:26.845726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:26.846153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:26.846827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:26.847273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:26.847722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:26.980326 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:26.988270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4cfeeb2b-00aa-4ba8-a367-1e51176dc60c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.154546 Aug 06 22:18:26.988874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 499/973] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:26 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:28.013001 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:28.013615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:28.020160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:28.020668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:28.021103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:28.021814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:28.022274 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:28.022695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:28.150949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:28.159385 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-16e76448-72a1-46b8-862f-01e5b694bebf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.150404 Aug 06 22:18:28.159934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 475/974] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:28 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:29.180959 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:29.181671 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:29.188264 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:29.188878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:29.189318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:29.190130 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:29.190590 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:29.191016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:29.323738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:29.332514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-64d22de5-535a-46e7-a772-a35786e8aea6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.155660 Aug 06 22:18:29.333079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 500/975] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:29 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:30.354825 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:30.355440 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:30.362822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:30.363314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:30.363747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:30.364468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:30.364923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:30.365347 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:30.493425 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:30.501555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5ff5eb36-2507-41fe-b1f8-35e3be830154 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.150661 Aug 06 22:18:30.502109 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 476/976] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:30 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:31.523135 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:31.523755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:31.530472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:31.530963 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:31.531400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:31.532100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:31.532595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:31.533027 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:31.663635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:31.672801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a487d358-ecbc-477d-a720-8952538361c3 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.153643 Aug 06 22:18:31.675905 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 501/977] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:31 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:32.694336 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:32.694887 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:32.702054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:32.705469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:32.705469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:32.705469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:32.705469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:32.706014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:32.835189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:32.843234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-79916b2e-ffd9-4608-9cb2-2be17c8d62a6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.152937 Aug 06 22:18:32.843794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 477/978] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:32 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:33.864034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:33.864623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:33.871414 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:33.871902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:33.872422 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:33.873233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:33.873683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:33.874104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:34.004825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:34.013968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9e5434f1-131d-41ad-951d-a8206edbe5c9 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.152627 Aug 06 22:18:34.015592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 502/979] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:33 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:35.036095 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:35.036740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:35.043668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:35.044147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:35.044625 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:35.045312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:35.045762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:35.046180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:35.176143 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:35.184389 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ace8aaa7-203d-444d-b11d-f07a06367f41 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.152261 Aug 06 22:18:35.185088 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 478/980] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:35 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:36.205112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:36.205706 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:36.212227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:36.212811 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:36.213247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:36.213935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:36.214426 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:36.214851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:36.344556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:36.350939 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5a0dab19-d526-43d1-b202-9a80f8d25118 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.149664 Aug 06 22:18:36.351537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 503/981] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:36 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:37.373440 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:37.374064 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:37.376548 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=57 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:37.381237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:37.381683 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:37.382112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:37.382798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:37.383243 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:37.383698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:37.511077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:37.519525 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-cd2d77b0-eaf3-4ad2-9237-260f2b238792 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.150279 Aug 06 22:18:37.520077 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 479/982] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:37 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:38.541311 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:38.541923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:38.548977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:38.549462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:38.549896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:38.550581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:38.551034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:38.551458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:38.683405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:38.691374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0b7d4d31-c2fa-448c-977d-10458eaaabb8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1734 microversion: 2.1 time: 0.153929 Aug 06 22:18:38.691939 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 504/983] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:38 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:39.711731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:39.712342 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:39.719409 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:39.721256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:39.721256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:39.721480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:39.721774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:39.722199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:39.850161 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:39.858783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-374f2bd5-9add-483a-88b7-8f9a5003cd08 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1714 microversion: 2.1 time: 0.150879 Aug 06 22:18:39.859348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 480/984] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:39 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:39.944730 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:39.945218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:39.951667 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:39.952182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:39.952642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:39.953330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:39.953780 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:39.954203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:40.032634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] HTTP exception thrown: Cannot 'detach_volume' instance 52d2f2af-bc41-42c1-9546-a62b80daea75 while it is in vm_state rescued Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Request method failure captured: Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments/08378591-704d-4cd6-95d0-c367a56e4c91 HTTP/1.1 Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7udZGdKqrZM6ePWm1NQTP4djHVVMKMfpH91VVhsbg1Ih5klYx1TuUmO5tg3BHc8qKERiGXBfZq_1iOaksAzWpgvxzeTUsKZRp1JdHqRnblGCGS9K2_2sWw2sp9H7GvzqWWtb2VQtM3RegT0Qiau3QL0y_a3lxZGidgEP423j_l3VubM Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:18:40.034237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_480896a54dab43c8980c8b05c9a793e7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 700f40b4567a4bcdbb2194861f4497d5 Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:18:40.035752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Cannot 'detach_volume' instance 52d2f2af-bc41-42c1-9546-a62b80daea75 while it is in vm_state rescued Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'server_id': '52d2f2af-bc41-42c1-9546-a62b80daea75', 'id': '08378591-704d-4cd6-95d0-c367a56e4c91'} Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52d2f2af-bc41-42c1-9546-a62b80daea75 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:18:40.036483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 52d2f2af-bc41-42c1-9546-a62b80daea75 while it is in vm_state rescued Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 52d2f2af-bc41-42c1-9546-a62b80daea75 while it is in vm_state rescued Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:40.038064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Returning 409 to user: Cannot 'detach_volume' instance 52d2f2af-bc41-42c1-9546-a62b80daea75 while it is in vm_state rescued {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:18:40.039251 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1811ce8d-ab92-4de7-bdfe-686e528d355c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments/08378591-704d-4cd6-95d0-c367a56e4c91" status: 409 len: 152 microversion: 2.1 time: 0.095087 Aug 06 22:18:40.039251 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 505/985] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:18:39 2022] DELETE /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments/08378591-704d-4cd6-95d0-c367a56e4c91 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 22:18:40.044574 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:40.045102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:40.050851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:40.051333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:40.051760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:40.052459 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:40.052907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:40.053323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:40.305142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-20eb6d42-b96e-4659-b5b5-1967c603606a tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "POST /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/action" status: 202 len: 0 microversion: 2.1 time: 0.264309 Aug 06 22:18:40.305804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 481/986] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:18:40 2022] POST /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:18:40.315642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:40.316610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:40.322830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:40.323318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:40.323752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:40.324477 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:40.324935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:40.325417 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:40.461830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:40.470611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-83cad231-c415-4ff8-9c63-6ec739369415 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1722 microversion: 2.1 time: 0.160675 Aug 06 22:18:40.471173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 506/987] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:40 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:41.447896 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1138173685"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:41.448543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:41.454718 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:41.455204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:41.455635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:41.456321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:41.456800 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:41.457225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:41.474530 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:41.491046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:41.491656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:41.498495 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:41.498985 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:41.499420 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:41.500121 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:41.500723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:41.501147 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:41.618938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.network.security_group_api [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Removing security group 04f46ec3-50d1-4213-a85f-a21992a3371a from port cf0a94b0-3677-4694-8913-092e34a6b8cf Aug 06 22:18:41.706944 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:41.710459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=100 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:41.715240 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9f9cac77-0d0c-45c1-a9ac-48db37a176e6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1722 microversion: 2.1 time: 0.228092 Aug 06 22:18:41.728587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 507/988] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:41 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:18:42.025156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ea7a81e7-fb6b-4ef1-96f2-98ee78bc7168 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "POST /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/action" status: 202 len: 0 microversion: 2.1 time: 0.582014 Aug 06 22:18:42.025803 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 482/989] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:18:41 2022] POST /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:18:42.035150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-8c215436-ce19-437a-9474-1206cc65520d req-89971e67-bec6-45b7-b2a2-475992401835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae294de-ba68-4354-a1de-e7ba7571b870", "tag": "cf0a94b0-3677-4694-8913-092e34a6b8cf"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:42.044926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-8c215436-ce19-437a-9474-1206cc65520d req-89971e67-bec6-45b7-b2a2-475992401835 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:42.045405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-8c215436-ce19-437a-9474-1206cc65520d req-89971e67-bec6-45b7-b2a2-475992401835 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:42.045833 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-8c215436-ce19-437a-9474-1206cc65520d req-89971e67-bec6-45b7-b2a2-475992401835 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:42.057018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-8c215436-ce19-437a-9474-1206cc65520d req-89971e67-bec6-45b7-b2a2-475992401835 service nova] Creating event network-changed:cf0a94b0-3677-4694-8913-092e34a6b8cf for instance cae294de-ba68-4354-a1de-e7ba7571b870 on hv-cinder-84984 Aug 06 22:18:42.062051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-8c215436-ce19-437a-9474-1206cc65520d req-89971e67-bec6-45b7-b2a2-475992401835 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030851 Aug 06 22:18:42.062929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 508/990] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:42.738483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:42.739097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:42.745128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:42.745613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:42.746051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:42.746742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:42.747200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:42.747628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:43.211382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:43.220170 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6a97753a-d021-4f12-8eb4-d1cc63d16d02 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1722 microversion: 2.1 time: 0.486152 Aug 06 22:18:43.220789 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 483/991] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:42 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1722 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:43.482601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:43.483177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:43.489573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:43.490062 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:43.490501 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:43.491189 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:43.491642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:43.492065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:43.571766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lazy-loading 'services' on Instance uuid cae294de-ba68-4354-a1de-e7ba7571b870 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:18:43.786674 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cf4c21ce-8dfb-4a6c-a425-2ef14103d9c7 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments/0d76332e-274b-4d46-a2bb-8c665450d0b0" status: 202 len: 0 microversion: 2.1 time: 0.309115 Aug 06 22:18:43.787602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 509/992] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:18:43 2022] DELETE /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments/0d76332e-274b-4d46-a2bb-8c665450d0b0 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:18:43.796725 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:43.799411 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:43.813312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:43.813808 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:43.814267 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:43.814975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:43.815438 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:43.815855 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:43.846410 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-eb06608c-6bf6-4c20-abf1-e28843435f4e tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054687 Aug 06 22:18:43.851254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 484/993] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:18:43 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:44.079838 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-12822e9d-0456-4a39-a70a-f469e1e9b390 req-cc2a5b92-11cd-4917-9064-baa1091d124b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae294de-ba68-4354-a1de-e7ba7571b870", "tag": "cf0a94b0-3677-4694-8913-092e34a6b8cf"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:44.091719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-12822e9d-0456-4a39-a70a-f469e1e9b390 req-cc2a5b92-11cd-4917-9064-baa1091d124b service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:44.092473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-12822e9d-0456-4a39-a70a-f469e1e9b390 req-cc2a5b92-11cd-4917-9064-baa1091d124b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:44.093079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-12822e9d-0456-4a39-a70a-f469e1e9b390 req-cc2a5b92-11cd-4917-9064-baa1091d124b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:44.106009 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-12822e9d-0456-4a39-a70a-f469e1e9b390 req-cc2a5b92-11cd-4917-9064-baa1091d124b service nova] Creating event network-changed:cf0a94b0-3677-4694-8913-092e34a6b8cf for instance cae294de-ba68-4354-a1de-e7ba7571b870 on hv-cinder-84984 Aug 06 22:18:44.110949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-12822e9d-0456-4a39-a70a-f469e1e9b390 req-cc2a5b92-11cd-4917-9064-baa1091d124b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037203 Aug 06 22:18:44.111533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 510/994] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:44.242276 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:44.242897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:44.249177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:44.249664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:44.250098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:44.250798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:44.251264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:44.251676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:44.391562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:44.400273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2bdbed29-030e-4adc-b37d-bfb3ff350745 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1722 microversion: 2.1 time: 0.161431 Aug 06 22:18:44.401307 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 485/995] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:44 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:44.860562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:44.862709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:44.868937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:44.869416 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:44.869850 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:44.870539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:44.870991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:44.871412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:44.900295 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c268cd73-ad21-414b-9979-7e76708939e8 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Aug 06 22:18:44.900873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 511/996] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:18:44 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:45.422785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:45.423531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:45.431901 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:45.432388 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:45.432848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:45.433557 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:45.433992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:45.435031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:45.566823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:45.574682 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8d9d10e2-983f-4de2-9cfd-21f81599b95e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1728 microversion: 2.1 time: 0.156196 Aug 06 22:18:45.575679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 486/997] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:45 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:45.595809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:45.596301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:45.602497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:45.602977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:45.603406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:45.604089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:45.604574 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:45.604994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:45.687186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-377a16eb-3742-4957-a9d9-4ea27d4c2297 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095386 Aug 06 22:18:45.687811 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 512/998] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Aug 6 22:18:45 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:45.913784 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:45.916388 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:45.923186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:45.923765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:45.924479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:45.925442 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:45.925926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:45.926349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:45.961438 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-325c68b5-5489-4a46-849e-0533d4697140 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051903 Aug 06 22:18:45.962585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 487/999] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:18:45 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:18:45.974024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:45.974656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:45.980724 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:45.981208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:45.981883 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:45.982635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:45.983091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:45.983510 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:46.063366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] HTTP exception thrown: Instance cae294de-ba68-4354-a1de-e7ba7571b870 is not attached to volume 0d76332e-274b-4d46-a2bb-8c665450d0b0 Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Request method failure captured: Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments/0d76332e-274b-4d46-a2bb-8c665450d0b0 HTTP/1.1 Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ueg5p--jGjHiW9ZCRz3mRg-kvUyV75VA-Z40YCu5sqMLhCrZ3t5GNoBBf1B4t0Gq1ShgaQsmrlKavdFh7liaEd6XukZFD2WGjdTHxRKKCvhE6g8GqIpWtHMAT7hRIQPdiCIN76REZj-V99xksyh827DLWdHsa-SeR306uLIXM5cmmQ Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: a375619d804c4675a5b9115aa13759a8 Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-TestMinimumBasicScenario-9349906 Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:18:46.066094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a375619d804c4675a5b9115aa13759a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a375619d804c4675a5b9115aa13759a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a375619d804c4675a5b9115aa13759a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a375619d804c4675a5b9115aa13759a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-TestMinimumBasicScenario-9349906 Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: a375619d804c4675a5b9115aa13759a8 Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9349906 Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-TestMinimumBasicScenario-9349906-project Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 7a851cc02ef54ebc9101964bb5c0d9d7 Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-TestMinimumBasicScenario-9349906-project Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:18:46.067602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance cae294de-ba68-4354-a1de-e7ba7571b870 is not attached to volume 0d76332e-274b-4d46-a2bb-8c665450d0b0 Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'server_id': 'cae294de-ba68-4354-a1de-e7ba7571b870', 'id': '0d76332e-274b-4d46-a2bb-8c665450d0b0'} Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0d76332e-274b-4d46-a2bb-8c665450d0b0. Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:18:46.068298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae294de-ba68-4354-a1de-e7ba7571b870 is not attached to volume 0d76332e-274b-4d46-a2bb-8c665450d0b0 Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae294de-ba68-4354-a1de-e7ba7571b870 is not attached to volume 0d76332e-274b-4d46-a2bb-8c665450d0b0 Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:18:46.069932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Returning 404 to user: Instance cae294de-ba68-4354-a1de-e7ba7571b870 is not attached to volume 0d76332e-274b-4d46-a2bb-8c665450d0b0 {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:18:46.071332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bdc11556-3747-45f3-9cf0-35b4282ade34 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments/0d76332e-274b-4d46-a2bb-8c665450d0b0" status: 404 len: 154 microversion: 2.1 time: 0.098730 Aug 06 22:18:46.071332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 513/1000] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:18:45 2022] DELETE /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870/os-volume_attachments/0d76332e-274b-4d46-a2bb-8c665450d0b0 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:18:46.667394 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-ad894559-a67a-4f93-9001-c572034e3f63 req-4b1f46b3-1443-4e80-a65f-7418cfe985d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d2f2af-bc41-42c1-9546-a62b80daea75", "tag": "028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:46.684123 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ad894559-a67a-4f93-9001-c572034e3f63 req-4b1f46b3-1443-4e80-a65f-7418cfe985d9 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:46.685295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ad894559-a67a-4f93-9001-c572034e3f63 req-4b1f46b3-1443-4e80-a65f-7418cfe985d9 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:46.686342 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ad894559-a67a-4f93-9001-c572034e3f63 req-4b1f46b3-1443-4e80-a65f-7418cfe985d9 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:46.699544 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-ad894559-a67a-4f93-9001-c572034e3f63 req-4b1f46b3-1443-4e80-a65f-7418cfe985d9 service nova] Creating event network-changed:028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4 for instance 52d2f2af-bc41-42c1-9546-a62b80daea75 on hv-cinder-84984 Aug 06 22:18:46.706420 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-ad894559-a67a-4f93-9001-c572034e3f63 req-4b1f46b3-1443-4e80-a65f-7418cfe985d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043357 Aug 06 22:18:46.713195 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 488/1001] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:47.378273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:47.378787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:47.385312 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:47.386086 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:47.386222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:47.387022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:47.387370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:47.388081 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:47.416563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:18:47.713075 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-88d49850-0b18-4773-8d84-cae2999accf2 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 204 len: 0 microversion: 2.1 time: 0.338343 Aug 06 22:18:47.713668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 514/1002] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:18:47 2022] DELETE /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:18:47.724032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:47.724818 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:47.730942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:47.732078 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:47.732675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:47.733371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:47.733827 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:47.734254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:47.866749 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:47.874323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-725df846-49e6-43b6-9798-ef02594edfbd tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1554 microversion: 2.1 time: 0.155404 Aug 06 22:18:47.874919 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 489/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:47 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:48.721808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-8a3cd30a-32e4-42d1-8016-74f873900055 req-10fc99ff-2782-48e5-b8ac-c98ce9d03fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d2f2af-bc41-42c1-9546-a62b80daea75", "tag": "028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:48.731946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-8a3cd30a-32e4-42d1-8016-74f873900055 req-10fc99ff-2782-48e5-b8ac-c98ce9d03fee service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:48.732432 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-8a3cd30a-32e4-42d1-8016-74f873900055 req-10fc99ff-2782-48e5-b8ac-c98ce9d03fee service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:48.732856 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-8a3cd30a-32e4-42d1-8016-74f873900055 req-10fc99ff-2782-48e5-b8ac-c98ce9d03fee service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:48.743401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-8a3cd30a-32e4-42d1-8016-74f873900055 req-10fc99ff-2782-48e5-b8ac-c98ce9d03fee service nova] Creating event network-changed:028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4 for instance 52d2f2af-bc41-42c1-9546-a62b80daea75 on hv-cinder-84984 Aug 06 22:18:48.748942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-8a3cd30a-32e4-42d1-8016-74f873900055 req-10fc99ff-2782-48e5-b8ac-c98ce9d03fee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031229 Aug 06 22:18:48.749504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 515/1004] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:48.895801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:48.896417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:48.903487 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:48.903976 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:48.904434 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:48.905124 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:48.905570 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:48.905988 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:49.033091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:49.040554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-65d0f95d-c787-48de-85fd-fcca78d6b347 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1554 microversion: 2.1 time: 0.148758 Aug 06 22:18:49.041112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 490/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:48 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:50.062509 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:50.063233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:50.065828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:18:50.070646 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:50.071125 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:50.071558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:50.072242 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:50.072723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:50.073149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:50.203854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:50.211485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f2ff2084-545a-4317-97e4-da568f09cb1f tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1554 microversion: 2.1 time: 0.153306 Aug 06 22:18:50.216330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 516/1006] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:50 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:50.713787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-60145d29-d473-4b05-bce7-14f454b0b324 req-50c5c30a-9bf5-454e-a33a-d6eeb95226b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae294de-ba68-4354-a1de-e7ba7571b870", "name": "network-vif-deleted", "tag": "cf0a94b0-3677-4694-8913-092e34a6b8cf"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:18:50.724014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-60145d29-d473-4b05-bce7-14f454b0b324 req-50c5c30a-9bf5-454e-a33a-d6eeb95226b6 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:50.724535 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-60145d29-d473-4b05-bce7-14f454b0b324 req-50c5c30a-9bf5-454e-a33a-d6eeb95226b6 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:50.724949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-60145d29-d473-4b05-bce7-14f454b0b324 req-50c5c30a-9bf5-454e-a33a-d6eeb95226b6 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:50.737860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-60145d29-d473-4b05-bce7-14f454b0b324 req-50c5c30a-9bf5-454e-a33a-d6eeb95226b6 service nova] Creating event network-vif-deleted:cf0a94b0-3677-4694-8913-092e34a6b8cf for instance cae294de-ba68-4354-a1de-e7ba7571b870 on hv-cinder-84984 Aug 06 22:18:50.740881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-60145d29-d473-4b05-bce7-14f454b0b324 req-50c5c30a-9bf5-454e-a33a-d6eeb95226b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Aug 06 22:18:50.741466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 491/1007] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:18:51.234171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:51.234791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:51.241890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:51.242343 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:51.242884 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:51.243597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:51.244089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:51.244647 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:51.276821 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:51.277304 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:51.277742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:51.278714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lazy-loading 'fault' on Instance uuid cae294de-ba68-4354-a1de-e7ba7571b870 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:18:51.322464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a851cc02ef54ebc9101964bb5c0d9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a375619d804c4675a5b9115aa13759a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:18:51.330881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b5bc4434-6a4c-4238-a901-d7ed9934f1b6 tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 200 len: 1348 microversion: 2.1 time: 0.100863 Aug 06 22:18:51.331441 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 517/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:51 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:18:52.353091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:52.353502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] [instance: cae294de-ba68-4354-a1de-e7ba7571b870] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:18:52.362466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:52.363305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:52.364023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:52.365222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:18:52.365968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:18:52.366657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:18:52.380951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] HTTP exception thrown: Instance cae294de-ba68-4354-a1de-e7ba7571b870 could not be found. Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Request method failure captured: Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 HTTP/1.1 Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ueg5p--jGjHiW9ZCRz3mRg-kvUyV75VA-Z40YCu5sqMLhCrZ3t5GNoBBf1B4t0Gq1ShgaQsmrlKavdFh7liaEd6XukZFD2WGjdTHxRKKCvhE6g8GqIpWtHMAT7hRIQPdiCIN76REZj-V99xksyh827DLWdHsa-SeR306uLIXM5cmmQ Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: a375619d804c4675a5b9115aa13759a8 Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-TestMinimumBasicScenario-9349906 Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:18:52.382589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a375619d804c4675a5b9115aa13759a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a375619d804c4675a5b9115aa13759a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a375619d804c4675a5b9115aa13759a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a375619d804c4675a5b9115aa13759a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-TestMinimumBasicScenario-9349906 Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: a375619d804c4675a5b9115aa13759a8 Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9349906 Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-TestMinimumBasicScenario-9349906-project Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 7a851cc02ef54ebc9101964bb5c0d9d7 Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-TestMinimumBasicScenario-9349906-project Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance cae294de-ba68-4354-a1de-e7ba7571b870 could not be found. Aug 06 22:18:52.384067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': 'cae294de-ba68-4354-a1de-e7ba7571b870'} Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae294de-ba68-4354-a1de-e7ba7571b870 could not be found. Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:18:52.385042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae294de-ba68-4354-a1de-e7ba7571b870 could not be found. Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae294de-ba68-4354-a1de-e7ba7571b870 could not be found. Aug 06 22:18:52.386606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:18:52.388627 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Returning 404 to user: Instance cae294de-ba68-4354-a1de-e7ba7571b870 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:18:52.388627 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-535bd4ba-2051-4c33-8900-6d1e4caef9fe tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870" status: 404 len: 111 microversion: 2.1 time: 0.036474 Aug 06 22:18:52.388627 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 492/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:18:52 2022] GET /compute/v2.1/servers/cae294de-ba68-4354-a1de-e7ba7571b870 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:18:52.393344 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0dff5846-31a5-4cdf-8272-7f83f5e3342c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] Calling method '.version_select at 0x7f30c68450d0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:18:52.475195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0dff5846-31a5-4cdf-8272-7f83f5e3342c tempest-TestMinimumBasicScenario-9349906 tempest-TestMinimumBasicScenario-9349906-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1006183456" status: 202 len: 0 microversion: 2.1 time: 0.085298 Aug 06 22:18:52.475776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 518/1010] 10.222.0.18 () {58 vars in 1272 bytes} [Sat Aug 6 22:18:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1006183456 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:19:44.647589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:44.648141 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:44.650299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=27 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:19:44.650959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=48 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:19:44.656642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:44.657126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:44.657560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:44.658249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:44.658703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:44.659131 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:44.781232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lazy-loading 'services' on Instance uuid 52d2f2af-bc41-42c1-9546-a62b80daea75 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:19:45.139340 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-df5d821b-ca3f-4908-a4e5-045bcf3670d8 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments/08378591-704d-4cd6-95d0-c367a56e4c91" status: 202 len: 0 microversion: 2.1 time: 0.495584 Aug 06 22:19:45.139851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 493/1011] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:19:44 2022] DELETE /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments/08378591-704d-4cd6-95d0-c367a56e4c91 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:19:45.145938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:19:45.146696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:19:45.150813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:45.152962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:45.159903 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:45.160392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:45.160862 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:45.161559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:45.162018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:45.162448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:45.192311 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-15133401-ef7f-4a83-b601-f0506a3f2e6e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047992 Aug 06 22:19:45.199651 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 519/1012] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:19:45 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:19:46.211715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:46.214108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:46.220955 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:46.221464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:46.221925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:46.222612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:46.223335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:46.223770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:46.253047 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a4f37c37-093b-4f52-87c5-229bd31edfc2 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 Aug 06 22:19:46.253930 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 494/1013] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:19:46 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:19:46.259263 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:46.259812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:46.267791 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:46.268268 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:46.268723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:46.269406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:46.269849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:46.270265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:46.292856 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c536b76b-1d3c-4dcf-aad0-88d53ed6e247 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037762 Aug 06 22:19:46.293409 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 520/1014] 10.222.0.18 () {60 vars in 1289 bytes} [Sat Aug 6 22:19:46 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:19:47.265038 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:47.267257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:47.273567 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:47.274045 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:47.274475 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:47.275149 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:47.275594 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:47.276060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:47.304531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e71e4333-8b4f-42ec-8267-c177880ef48e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043523 Aug 06 22:19:47.305076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 495/1015] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:19:47 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:19:47.396690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:47.397207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:47.404178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:47.405526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:47.408468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:47.408468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:47.408468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:47.408468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:47.435588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:19:47.722472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4d89bd58-1faa-479a-a81d-0934f032e687 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 204 len: 0 microversion: 2.1 time: 0.330136 Aug 06 22:19:47.723338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 521/1016] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:19:47 2022] DELETE /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 22:19:47.731207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:47.731838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:47.737779 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:47.738257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:47.738684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:47.739359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:47.739807 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:47.740220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:47.873981 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:47.881688 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fc394a1b-ba84-4c57-91e7-4e80724c6d14 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1688 microversion: 2.1 time: 0.154241 Aug 06 22:19:47.882280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 496/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:47 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:48.387796 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:48.388485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:48.394493 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:48.394968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:48.395395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:48.396071 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:48.396541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:48.396961 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:48.419292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5003b704-f4c4-4b86-8e0b-5566f5f76111 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/ips" status: 200 len: 151 microversion: 2.1 time: 0.035697 Aug 06 22:19:48.419838 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 522/1018] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:19:48 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:19:48.904339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:48.905523 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:48.911867 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:48.912589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:48.912808 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:48.913499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:48.913948 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:48.914377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:49.053912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:49.058138 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2155ce04-d55f-473c-a191-91c6b5f9cc11 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1688 microversion: 2.1 time: 0.157723 Aug 06 22:19:49.058681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 497/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:48 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:49.583247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:19:49.583806 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:49.590244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:49.590726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:49.591166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:49.592027 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:49.592538 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:49.592965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:49.615896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lazy-loading 'flavor' on Instance uuid 2d13c88b-ec4a-4fc4-af59-8fe95949327f {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:19:50.048273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-89e09d0c-1ccd-496f-8117-131d262e81dd tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/action" status: 202 len: 0 microversion: 2.20 time: 0.468844 Aug 06 22:19:50.048890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 523/1020] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Aug 6 22:19:49 2022] POST /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:19:50.057043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:50.059966 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:50.064224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:50.064740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:50.065208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:50.065897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:50.066369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:50.066774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:50.079616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:50.080309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:50.086556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:50.087036 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:50.087542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:50.088222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:50.088709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:50.094274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:50.263526 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:50.270692 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:50.271531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:50.273061 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:50.274307 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3ebaa5fc-3033-4d35-beb1-de12d038f842 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.221182 Aug 06 22:19:50.274860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 498/1021] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:50 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:19:50.279018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c8704f47-74ae-46b8-9f14-0a27d5f69a32 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1688 microversion: 2.1 time: 0.203644 Aug 06 22:19:50.280165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 524/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:50 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:19:51.094961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "479b6c3f-7b83-42b6-958d-b725d7f9d20f"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:19:51.097402 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:51.104053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:51.104556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:51.104989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:51.105672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:51.106121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:51.106552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:51.298369 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:51.298911 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:51.305448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:51.305925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:51.306358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:51.307043 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:51.307493 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:51.307916 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:51.436516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:51.444386 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:51.445907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:51.447053 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9bdcf171-6e5a-4c47-b95c-3842414305ac tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.152728 Aug 06 22:19:51.447594 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 525/1023] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:51 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:19:51.460529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:51.460529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:51.462800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:51.463287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:51.463726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:51.464429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:51.464891 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:51.465317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:51.600736 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:51.608617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1b1c7d58-fce1-4e47-9c63-f8920dd430ee tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1688 microversion: 2.1 time: 0.160018 Aug 06 22:19:51.609383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 526/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:51 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:52.161520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c0b5d869-f053-40a7-957b-2f88b0d0a883 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.070417 Aug 06 22:19:52.167542 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 499/1025] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:19:51 2022] POST /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments => generated 194 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:19:52.473072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:52.473781 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:52.481568 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:52.482345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:52.483305 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:52.484114 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:52.485460 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:52.486147 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:52.493992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-e490efb4-3983-4a1e-a23b-b6cab9bcc4b6 req-8cc948cb-1ec3-48ff-b9e2-73211a91c39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d2f2af-bc41-42c1-9546-a62b80daea75", "name": "network-vif-deleted", "tag": "028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:19:52.507524 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e490efb4-3983-4a1e-a23b-b6cab9bcc4b6 req-8cc948cb-1ec3-48ff-b9e2-73211a91c39b service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:52.511033 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e490efb4-3983-4a1e-a23b-b6cab9bcc4b6 req-8cc948cb-1ec3-48ff-b9e2-73211a91c39b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:52.511033 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-e490efb4-3983-4a1e-a23b-b6cab9bcc4b6 req-8cc948cb-1ec3-48ff-b9e2-73211a91c39b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:52.522645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-e490efb4-3983-4a1e-a23b-b6cab9bcc4b6 req-8cc948cb-1ec3-48ff-b9e2-73211a91c39b service nova] Creating event network-vif-deleted:028ab5fe-c4de-4d3b-ab75-ea12c24aa6f4 for instance 52d2f2af-bc41-42c1-9546-a62b80daea75 on hv-cinder-84984 Aug 06 22:19:52.529783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-e490efb4-3983-4a1e-a23b-b6cab9bcc4b6 req-8cc948cb-1ec3-48ff-b9e2-73211a91c39b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039978 Aug 06 22:19:52.534369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 500/1026] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:19:52.631997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:52.633051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:52.641437 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:52.642223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:52.642853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:52.643607 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:52.644078 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:52.644536 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:52.657104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:52.666520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:52.668040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:52.670606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-902c42fd-1a19-473d-a26d-4bdd91d26462 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.201018 Aug 06 22:19:52.676544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 527/1027] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:52 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:19:52.754395 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:52.757331 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-29ddd885-df74-41f2-8145-fa066c467bf1 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 200 len: 1329 microversion: 2.1 time: 0.130149 Aug 06 22:19:52.770753 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 501/1028] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:52 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 1329 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:53.695340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:53.695906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:53.702740 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:53.703241 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:53.703669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:53.704358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:53.704829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:53.705246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:53.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:53.778786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: 52d2f2af-bc41-42c1-9546-a62b80daea75] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:53.785435 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:53.785924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:53.786361 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:53.787055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:53.787507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:53.787932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:53.801356 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] HTTP exception thrown: Instance 52d2f2af-bc41-42c1-9546-a62b80daea75 could not be found. Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Request method failure captured: Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 HTTP/1.1 Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7udZGdKqrZM6ePWm1NQTP4djHVVMKMfpH91VVhsbg1Ih5klYx1TuUmO5tg3BHc8qKERiGXBfZq_1iOaksAzWpgvxzeTUsKZRp1JdHqRnblGCGS9K2_2sWw2sp9H7GvzqWWtb2VQtM3RegT0Qiau3QL0y_a3lxZGidgEP423j_l3VubM Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:19:53.802995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_480896a54dab43c8980c8b05c9a793e7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 700f40b4567a4bcdbb2194861f4497d5 Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 52d2f2af-bc41-42c1-9546-a62b80daea75 could not be found. Aug 06 22:19:53.804634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '52d2f2af-bc41-42c1-9546-a62b80daea75'} Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d2f2af-bc41-42c1-9546-a62b80daea75 could not be found. Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:19:53.805621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d2f2af-bc41-42c1-9546-a62b80daea75 could not be found. Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d2f2af-bc41-42c1-9546-a62b80daea75 could not be found. Aug 06 22:19:53.807116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:19:53.808554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Returning 404 to user: Instance 52d2f2af-bc41-42c1-9546-a62b80daea75 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:19:53.808554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ea6b27a1-b461-4a94-8c2f-f20b6f37f79e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75" status: 404 len: 111 microversion: 2.1 time: 0.030134 Aug 06 22:19:53.808554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 502/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:53 2022] GET /compute/v2.1/servers/52d2f2af-bc41-42c1-9546-a62b80daea75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 22:19:53.813340 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-db12d012-1739-49e4-a14e-5146d5716e4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '.version_select at 0x7f30c6b67d30>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:53.886158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:53.895070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:53.896581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:53.897737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-91642ecb-9ec6-48d8-909d-cae1756e2c3e tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.206447 Aug 06 22:19:53.898277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 528/1030] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:53 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:19:53.918225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-db12d012-1739-49e4-a14e-5146d5716e4e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-600796928" status: 202 len: 0 microversion: 2.1 time: 0.108912 Aug 06 22:19:53.918799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 503/1031] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Aug 6 22:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-600796928 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:19:54.477789 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:54.478288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:54.480206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-0999eee8-cc6b-473d-a58d-00921e3e8e9b req-529461d7-1448-4ec5-92eb-207e1a9f8b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf8ec91-febf-4f9e-a540-08f48c5baae8", "tag": "a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:19:54.484726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:54.485209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:54.490985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-0999eee8-cc6b-473d-a58d-00921e3e8e9b req-529461d7-1448-4ec5-92eb-207e1a9f8b7f service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:54.491709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-0999eee8-cc6b-473d-a58d-00921e3e8e9b req-529461d7-1448-4ec5-92eb-207e1a9f8b7f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:54.492144 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-0999eee8-cc6b-473d-a58d-00921e3e8e9b req-529461d7-1448-4ec5-92eb-207e1a9f8b7f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:54.493002 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:54.493743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:54.494277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:54.494901 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:54.504121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-0999eee8-cc6b-473d-a58d-00921e3e8e9b req-529461d7-1448-4ec5-92eb-207e1a9f8b7f service nova] Creating event network-changed:a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e for instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 on hv-cinder-84984 Aug 06 22:19:54.509261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-0999eee8-cc6b-473d-a58d-00921e3e8e9b req-529461d7-1448-4ec5-92eb-207e1a9f8b7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032990 Aug 06 22:19:54.511042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 504/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:19:54.533678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:19:54.757876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-92169189-e4d8-445c-b8f5-90abf94238b6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 204 len: 0 microversion: 2.1 time: 0.283955 Aug 06 22:19:54.762633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 529/1033] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:19:54 2022] DELETE /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:19:54.769023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:54.770004 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:54.777166 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:54.777930 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:54.778554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:54.780302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:54.780963 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:54.781573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:54.933639 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:54.934731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:54.936221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:54.944190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-11ffd5e9-9664-41af-93f8-e2d4bee2b2d6 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.179372 Aug 06 22:19:54.944804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 505/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:54 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:54.945849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:54.947520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:54.948060 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:54.948950 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:54.949406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:54.949828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:55.107871 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:55.112014 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:19:55.117159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:55.119094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:55.120193 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ba7e71db-3036-4db4-8f6b-fbfc0854a005 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.201535 Aug 06 22:19:55.120782 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 530/1035] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:54 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:19:55.965775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:55.966381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:55.973538 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:55.974011 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:55.974433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:55.975135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:55.975582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:55.975996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:56.105324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:56.113540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-28b401c8-2566-4b84-8613-e320a6e3e253 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1566 microversion: 2.1 time: 0.151780 Aug 06 22:19:56.114100 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 506/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:55 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:56.143287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:56.143901 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:56.151186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:56.151672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:56.152109 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:56.152826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:56.153276 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:56.153785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:56.290938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:56.300221 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:56.301738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:56.302913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9c49374a-3cea-408b-8e03-8591fa346d42 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.163714 Aug 06 22:19:56.303715 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 531/1037] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:56 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:19:57.134297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:57.134900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:57.141456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.141943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.142376 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:57.143067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.143519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.143943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:57.208615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:57.216220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2c6358da-8256-4d09-8d70-0af7209e437b tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1381 microversion: 2.1 time: 0.085777 Aug 06 22:19:57.217382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 507/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:57 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1381 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:57.291576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-e090ebb1-23f9-4ae5-b2e4-2a4486b2db71 req-6175667e-1213-422e-a1e0-551d79f86988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf8ec91-febf-4f9e-a540-08f48c5baae8", "name": "network-vif-deleted", "tag": "a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:19:57.302126 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e090ebb1-23f9-4ae5-b2e4-2a4486b2db71 req-6175667e-1213-422e-a1e0-551d79f86988 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.302612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e090ebb1-23f9-4ae5-b2e4-2a4486b2db71 req-6175667e-1213-422e-a1e0-551d79f86988 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.303113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e090ebb1-23f9-4ae5-b2e4-2a4486b2db71 req-6175667e-1213-422e-a1e0-551d79f86988 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:57.315291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-e090ebb1-23f9-4ae5-b2e4-2a4486b2db71 req-6175667e-1213-422e-a1e0-551d79f86988 service nova] Creating event network-vif-deleted:a5a1fd90-d1ab-4bc2-8ad9-880e9606e69e for instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 on hv-cinder-84984 Aug 06 22:19:57.320213 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-e090ebb1-23f9-4ae5-b2e4-2a4486b2db71 req-6175667e-1213-422e-a1e0-551d79f86988 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032393 Aug 06 22:19:57.323696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 532/1039] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:19:57.326258 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:57.326867 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:57.332861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.333341 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.333771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:57.334449 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.334897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.335320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:57.465205 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:57.474522 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:57.476368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:57.477597 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e012f3b7-3ce4-409f-b92c-d047671ee176 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.155144 Aug 06 22:19:57.478316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 508/1040] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:57 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:19:57.558108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:57.558691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:57.565389 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.565890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.566480 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:57.567191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.567682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.568109 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:57.594958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:19:57.894359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b2dfb16c-7935-49ae-b4ae-6b8d89361a69 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 204 len: 0 microversion: 2.1 time: 0.340281 Aug 06 22:19:57.894860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 533/1041] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:19:57 2022] DELETE /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:19:57.903405 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:57.904006 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:57.910712 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.911190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.911619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:57.912299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:57.912770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:57.913189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:58.044024 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:58.052062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-40cf7e5e-fafe-4586-ad66-1d7a85c9b13c tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1508 microversion: 2.1 time: 0.152507 Aug 06 22:19:58.052662 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 509/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:57 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:58.239326 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:58.240063 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:58.246061 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:58.253073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:58.253073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:58.253073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:58.253073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:58.253433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:58.283773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:58.284251 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:58.284712 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:58.285154 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lazy-loading 'fault' on Instance uuid 9bf8ec91-febf-4f9e-a540-08f48c5baae8 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:19:58.326536 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:58.335898 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8fa1c86a-346e-4451-9fa5-49b216ba8964 tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1223 microversion: 2.1 time: 0.100991 Aug 06 22:19:58.336484 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 534/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:58 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:58.501563 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:58.502132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:58.508428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:58.511472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:58.511472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:58.511472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:58.511472 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:58.511845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:58.529507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:19:58.642094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:58.650126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:58.651626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:58.652890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e15f3311-6458-41dc-bc48-87689066597c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.155735 Aug 06 22:19:58.653448 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 510/1044] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:58 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:19:59.073617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:59.074236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:59.080845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:59.081333 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:59.081768 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:59.082518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:59.083006 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:59.083436 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:59.358945 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:59.359940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:59.372799 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:59.373657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:59.374310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:59.375284 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:59.376939 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:59.381671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:59.452678 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:59.453374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:59.455695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:59.456382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lazy-loading 'fault' on Instance uuid 9bf8ec91-febf-4f9e-a540-08f48c5baae8 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:19:59.484332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:59.493032 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ca062ece-2c69-45eb-8945-141e1f66fa19 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1508 microversion: 2.1 time: 0.423160 Aug 06 22:19:59.493896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 535/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:59 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:19:59.500922 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9469cd012c2549288ba403902b667295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354597f8edf4ebc9539a33314e6bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:59.508129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-194032f7-8269-44ba-8107-6e5bb70747bb tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 200 len: 1177 microversion: 2.1 time: 0.153175 Aug 06 22:19:59.512554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 511/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:19:59 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 1177 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:19:59.676088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:19:59.676729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:19:59.682909 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:59.683393 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:59.683859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:59.684596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:59.685050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:59.685527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:59.839808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:59.840232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-32fc33ae-655f-4fbe-bcfe-d9b2d1237eb3 req-18b5ab30-858f-4c9f-b0f4-ba29a598f2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9f579b-0319-4f10-8add-f6841dff2c15", "name": "network-vif-deleted", "tag": "ead8bbbb-85ad-4109-8f01-4cebf7430d97"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:19:59.848565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:59.850181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:19:59.851294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f5c7a0ae-209d-4bce-be6d-ba09a3ee1f59 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.179328 Aug 06 22:19:59.851853 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 536/1047] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:19:59 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:19:59.907068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-32fc33ae-655f-4fbe-bcfe-d9b2d1237eb3 req-18b5ab30-858f-4c9f-b0f4-ba29a598f2bd service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:19:59.907463 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-32fc33ae-655f-4fbe-bcfe-d9b2d1237eb3 req-18b5ab30-858f-4c9f-b0f4-ba29a598f2bd service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:19:59.908125 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-32fc33ae-655f-4fbe-bcfe-d9b2d1237eb3 req-18b5ab30-858f-4c9f-b0f4-ba29a598f2bd service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:19:59.920021 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-32fc33ae-655f-4fbe-bcfe-d9b2d1237eb3 req-18b5ab30-858f-4c9f-b0f4-ba29a598f2bd service nova] Creating event network-vif-deleted:ead8bbbb-85ad-4109-8f01-4cebf7430d97 for instance ea9f579b-0319-4f10-8add-f6841dff2c15 on hv-cinder-84984 Aug 06 22:19:59.924927 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-32fc33ae-655f-4fbe-bcfe-d9b2d1237eb3 req-18b5ab30-858f-4c9f-b0f4-ba29a598f2bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088796 Aug 06 22:19:59.925513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 512/1048] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:20:00.514772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:00.515380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:00.521974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.522463 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.523028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.523722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.524171 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.524626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.529350 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:00.530047 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] [instance: 9bf8ec91-febf-4f9e-a540-08f48c5baae8] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:00.536699 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.537179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.537614 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.538302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.538757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.539183 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.553649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] HTTP exception thrown: Instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 could not be found. Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Request method failure captured: Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 HTTP/1.1 Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7udI9SZxS1irBTHbyB6GLcR5OtZBwjt7KycxIZDp2SIUPnxvcsfu4upoSATODae9ktBIyLQYyNop2gFBq5L-68aJq88TyxGK2bdteoqbHJyfNZJjKBX9M63TTcKTF2xfU5LqeP2WDQqWroiilZsk-1HeHLedQxctqIBQad6qpvIbtHQ Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 6354597f8edf4ebc9539a33314e6bc06 Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-TestShelveInstance-1804715575 Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:20:00.555280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6354597f8edf4ebc9539a33314e6bc06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6354597f8edf4ebc9539a33314e6bc06", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6354597f8edf4ebc9539a33314e6bc06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6354597f8edf4ebc9539a33314e6bc06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-TestShelveInstance-1804715575 Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 6354597f8edf4ebc9539a33314e6bc06 Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-TestShelveInstance-1804715575 Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-TestShelveInstance-1804715575-project Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 9469cd012c2549288ba403902b667295 Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-TestShelveInstance-1804715575-project Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 could not be found. Aug 06 22:20:00.556634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '9bf8ec91-febf-4f9e-a540-08f48c5baae8'} Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 could not be found. Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:20:00.557444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 could not be found. Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 could not be found. Aug 06 22:20:00.558632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.559736 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Returning 404 to user: Instance 9bf8ec91-febf-4f9e-a540-08f48c5baae8 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:20:00.559736 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-24cb21d2-ac36-4f27-94b4-e108b8afe75a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8" status: 404 len: 111 microversion: 2.1 time: 0.032020 Aug 06 22:20:00.559890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.559973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 513/1049] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:00 2022] GET /compute/v2.1/servers/9bf8ec91-febf-4f9e-a540-08f48c5baae8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 22:20:00.560055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.560055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.560055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lazy-loading 'fault' on Instance uuid ea9f579b-0319-4f10-8add-f6841dff2c15 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:20:00.601261 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:00.609172 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9dff7de9-5208-46b1-a5f2-5e3816da0ae6 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 200 len: 1311 microversion: 2.1 time: 0.098303 Aug 06 22:20:00.617298 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 537/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:00 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:00.773391 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3223a26c-d55b-4904-9827-16047edd107a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] Calling method '.version_select at 0x7f30c6a48af0>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:00.789868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "479b6c3f-7b83-42b6-958d-b725d7f9d20f"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:00.794083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:00.803830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.804330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.805598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.808884 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.808884 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.808884 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.859172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3223a26c-d55b-4904-9827-16047edd107a tempest-TestShelveInstance-1804715575 tempest-TestShelveInstance-1804715575-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-355030664" status: 202 len: 0 microversion: 2.1 time: 0.089657 Aug 06 22:20:00.859745 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 514/1051] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:20:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-355030664 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:20:00.874283 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:00.875031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:00.882085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.882792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.883214 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.884051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:00.884922 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:00.885552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:00.901037 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Invalid volume: volume 479b6c3f-7b83-42b6-958d-b725d7f9d20f is already attached to instances: 317f93e1-fb8d-4630-aa61-d3232597ddf9 Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: POST /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments HTTP/1.1 Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 74 Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:20:00.902772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {"volumeAttachment": {"volumeId": "479b6c3f-7b83-42b6-958d-b725d7f9d20f"}} Aug 06 22:20:00.904554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Invalid volume: volume 479b6c3f-7b83-42b6-958d-b725d7f9d20f is already attached to instances: 317f93e1-fb8d-4630-aa61-d3232597ddf9 Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'server_id': '317f93e1-fb8d-4630-aa61-d3232597ddf9', 'body': {'volumeAttachment': {'volumeId': '479b6c3f-7b83-42b6-958d-b725d7f9d20f'}}} Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 479b6c3f-7b83-42b6-958d-b725d7f9d20f is already attached to instances: 317f93e1-fb8d-4630-aa61-d3232597ddf9 Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.905449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 479b6c3f-7b83-42b6-958d-b725d7f9d20f is already attached to instances: 317f93e1-fb8d-4630-aa61-d3232597ddf9 Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:00.906854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:00.909978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:00.909978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:20:00.909978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:20:00.909978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 479b6c3f-7b83-42b6-958d-b725d7f9d20f is already attached to instances: 317f93e1-fb8d-4630-aa61-d3232597ddf9 Aug 06 22:20:00.909978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:00.909978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 400 to user: Invalid volume: volume 479b6c3f-7b83-42b6-958d-b725d7f9d20f is already attached to instances: 317f93e1-fb8d-4630-aa61-d3232597ddf9 {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:20:00.909978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-449a131b-0843-40d2-9deb-1a7861d9e582 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119821 Aug 06 22:20:00.909978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 538/1052] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:20:00 2022] POST /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:20:00.991617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:00.992227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:00.999819 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:01.000381 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:01.001021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:01.001852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:01.002378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:01.003015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:01.038225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:01.046802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:01.048368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:01.049610 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-aa217a8a-9193-4796-933b-9e3c14948c2a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.179238 Aug 06 22:20:01.050291 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 515/1053] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:00 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:01.087088 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lazy-loading 'services' on Instance uuid 317f93e1-fb8d-4630-aa61-d3232597ddf9 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:20:01.270926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7b6f614d-e5fd-4758-ae3c-7bce4a06791b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments/479b6c3f-7b83-42b6-958d-b725d7f9d20f" status: 202 len: 0 microversion: 2.1 time: 0.283980 Aug 06 22:20:01.271650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 539/1054] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:20:00 2022] DELETE /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments/479b6c3f-7b83-42b6-958d-b725d7f9d20f => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 22:20:01.282342 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:01.284908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:01.291669 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:01.292242 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:01.292704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:01.293760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:01.294217 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:01.294645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:01.324730 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d1591de7-1daf-4145-9474-56b4eeb8f5ef tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Aug 06 22:20:01.325315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 516/1055] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:20:01 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:20:01.631665 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:01.632447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: ea9f579b-0319-4f10-8add-f6841dff2c15] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:01.638517 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:01.639001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:01.639439 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:01.640136 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:01.640617 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:01.641137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:01.654864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] HTTP exception thrown: Instance ea9f579b-0319-4f10-8add-f6841dff2c15 could not be found. Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Request method failure captured: Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 HTTP/1.1 Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7udZGdKqrZM6ePWm1NQTP4djHVVMKMfpH91VVhsbg1Ih5klYx1TuUmO5tg3BHc8qKERiGXBfZq_1iOaksAzWpgvxzeTUsKZRp1JdHqRnblGCGS9K2_2sWw2sp9H7GvzqWWtb2VQtM3RegT0Qiau3QL0y_a3lxZGidgEP423j_l3VubM Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:20:01.656529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_480896a54dab43c8980c8b05c9a793e7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 700f40b4567a4bcdbb2194861f4497d5 Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance ea9f579b-0319-4f10-8add-f6841dff2c15 could not be found. Aug 06 22:20:01.657870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': 'ea9f579b-0319-4f10-8add-f6841dff2c15'} Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9f579b-0319-4f10-8add-f6841dff2c15 could not be found. Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:20:01.659196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9f579b-0319-4f10-8add-f6841dff2c15 could not be found. Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9f579b-0319-4f10-8add-f6841dff2c15 could not be found. Aug 06 22:20:01.661592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:01.662990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Returning 404 to user: Instance ea9f579b-0319-4f10-8add-f6841dff2c15 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:20:01.662990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-87266a60-da6b-4123-b82b-c20fc753d116 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15" status: 404 len: 111 microversion: 2.1 time: 0.031022 Aug 06 22:20:01.662990 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 540/1056] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:01 2022] GET /compute/v2.1/servers/ea9f579b-0319-4f10-8add-f6841dff2c15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:20:01.667222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:01.667737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:01.674259 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:01.675008 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:01.675441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:01.676132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:01.676612 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:01.677039 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:01.703167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:20:02.046813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0452aee3-90c1-42ae-8ab0-9868495dc0fa tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 204 len: 0 microversion: 2.1 time: 0.383057 Aug 06 22:20:02.048069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 517/1057] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:20:01 2022] DELETE /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:20:02.055992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:02.056687 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:02.062693 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:02.063187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:02.063626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:02.064901 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:02.065360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:02.065797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:02.072720 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:02.073546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:02.086973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:02.087238 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:02.087679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:02.088421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:02.088912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:02.095914 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:02.323934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:02.333354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:02.345162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-764997cb-3640-4877-978b-b3dfc4b40a74 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.292933 Aug 06 22:20:02.346308 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 541/1058] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:02 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:02.348211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:02.350009 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:02.353462 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3e650420-d77d-4cc1-a5b2-0ad22725078a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.282971 Aug 06 22:20:02.354613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 518/1059] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:02 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:20:02.355672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:02.362786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:02.369359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:02.370018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:02.370626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:02.371541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:02.371995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:02.372487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:02.406514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7346ff25-5423-4d28-ac82-997ed751aa27 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054455 Aug 06 22:20:02.407009 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 542/1060] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:20:02 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:20:03.369497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:03.370108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:03.382642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:03.382642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:03.382642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:03.382642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:03.383162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:03.383585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:03.383585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:03.383772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:03.397400 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:03.397899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:03.398350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:03.399045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:03.399718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:03.400144 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:03.620680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:03.630572 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1aa74039-f540-44df-bfa9-4afbcec0d851 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.264257 Aug 06 22:20:03.631163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 519/1061] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:03 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:03.636665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:03.639660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:03.647151 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:03.647637 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:03.648069 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:03.648793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:03.649318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:03.649589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:03.650015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:03.658361 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:03.660420 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:03.661708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-04998c90-8668-4c19-83c4-b52aa136290f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1744 microversion: 2.20 time: 0.286981 Aug 06 22:20:03.676825 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 543/1062] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:03 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1744 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:03.681800 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ae2f2808-d77f-4304-808c-47b23b725986 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049399 Aug 06 22:20:03.682469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 520/1063] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:20:03 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:20:03.746823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:03.747403 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:03.754451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:03.755572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:03.755572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:03.756169 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:03.756655 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:03.757144 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:03.784396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:20:03.820049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:04.105669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-03a79780-4f65-4cde-9698-18e17154aa73 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 204 len: 0 microversion: 2.1 time: 0.362419 Aug 06 22:20:04.106270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 544/1064] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:20:03 2022] DELETE /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:20:04.115766 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:04.116384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:04.122746 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:04.123455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:04.124068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:04.124791 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:04.125245 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:04.125836 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:04.288785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:04.297453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-035d4faf-ab1d-4d31-a563-87864bd6f546 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1681 microversion: 2.1 time: 0.186253 Aug 06 22:20:04.299404 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 521/1065] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:04 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:04.653751 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:04.655129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:04.663840 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:04.664618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:04.665061 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:04.666113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:04.666567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:04.667494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:04.694998 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:04.697661 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:04.707881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:04.709048 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:04.710396 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:04.711990 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:04.712714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:04.713921 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:04.864743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:04.877135 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e28d9000-7bcf-4901-a082-54b0c4dd7705 tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.229155 Aug 06 22:20:04.877719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 545/1066] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:04 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:04.932694 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:04.941555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:04.943854 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:04.945954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-edeb1707-b4bc-4357-8d94-9799ce2a168d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1744 microversion: 2.20 time: 0.260079 Aug 06 22:20:04.947034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 522/1067] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:04 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1744 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:05.320131 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:05.320796 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:05.326699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:05.327179 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:05.327852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:05.328289 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:05.328771 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:05.329197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:05.479503 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:05.488386 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-edbfd03a-c2bd-4e3f-8a95-e150cb0c28fc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1681 microversion: 2.1 time: 0.172356 Aug 06 22:20:05.489297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 546/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:05 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:20:05.898593 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:05.899233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:05.905569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:05.906049 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:05.906480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:05.907185 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:05.907618 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:05.908573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:05.970015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:05.972068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:05.978801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:05.979500 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:05.979934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:05.980875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:05.981491 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:05.981915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:06.073068 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:06.081435 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7fbd9f0a-6f08-451f-9381-ee36314382cf tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1521 microversion: 2.1 time: 0.186939 Aug 06 22:20:06.082215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 523/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:05 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:06.133602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:06.141837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:06.144182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:06.145479 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8e897d98-3be1-4f63-8243-f6bc50c1b357 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1744 microversion: 2.20 time: 0.179610 Aug 06 22:20:06.147217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 547/1070] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:05 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:20:06.332623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-d2fc2d8d-7b57-432a-b91e-dca40b0eaf91 req-8ba737b9-8730-4e05-978a-9cf633b2f58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fe6d06-81d1-46d4-a10a-54fc6d97cea9", "name": "network-vif-deleted", "tag": "af724266-6923-4b34-aa57-73b075c36dc5"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:06.350532 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-d2fc2d8d-7b57-432a-b91e-dca40b0eaf91 req-8ba737b9-8730-4e05-978a-9cf633b2f58b service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:06.351963 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-d2fc2d8d-7b57-432a-b91e-dca40b0eaf91 req-8ba737b9-8730-4e05-978a-9cf633b2f58b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:06.358311 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-d2fc2d8d-7b57-432a-b91e-dca40b0eaf91 req-8ba737b9-8730-4e05-978a-9cf633b2f58b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:06.373604 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-d2fc2d8d-7b57-432a-b91e-dca40b0eaf91 req-8ba737b9-8730-4e05-978a-9cf633b2f58b service nova] Creating event network-vif-deleted:af724266-6923-4b34-aa57-73b075c36dc5 for instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 on hv-cinder-84984 Aug 06 22:20:06.379736 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-d2fc2d8d-7b57-432a-b91e-dca40b0eaf91 req-8ba737b9-8730-4e05-978a-9cf633b2f58b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051488 Aug 06 22:20:06.380636 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 524/1071] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:20:06.510777 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-087f66af-f812-4602-a7f8-76a24619d117 req-a5cac6a3-7666-4739-8be6-bc7a37304318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d13c88b-ec4a-4fc4-af59-8fe95949327f", "name": "network-vif-plugged", "status": "completed", "tag": "69af86b5-7845-4fb4-ad57-44fa19c640b3"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:06.512105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:06.513144 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:06.521520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:06.522257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:06.522767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:06.523628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:06.523848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-087f66af-f812-4602-a7f8-76a24619d117 req-a5cac6a3-7666-4739-8be6-bc7a37304318 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:06.524074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:06.524515 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:06.524670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-087f66af-f812-4602-a7f8-76a24619d117 req-a5cac6a3-7666-4739-8be6-bc7a37304318 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:06.525222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-087f66af-f812-4602-a7f8-76a24619d117 req-a5cac6a3-7666-4739-8be6-bc7a37304318 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:06.539208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-087f66af-f812-4602-a7f8-76a24619d117 req-a5cac6a3-7666-4739-8be6-bc7a37304318 service nova] Creating event network-vif-plugged:69af86b5-7845-4fb4-ad57-44fa19c640b3 for instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f on hv-cinder-84984 Aug 06 22:20:06.544384 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-087f66af-f812-4602-a7f8-76a24619d117 req-a5cac6a3-7666-4739-8be6-bc7a37304318 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038711 Aug 06 22:20:06.545465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 548/1072] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:20:06.687624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:06.697474 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-49d7fb62-4d43-44fc-863f-732318159dfa tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1681 microversion: 2.1 time: 0.190213 Aug 06 22:20:06.698096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 525/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:06 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:07.104828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:07.105528 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:07.112496 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:07.113137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:07.113569 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:07.114271 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:07.115042 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:07.115464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:07.154274 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:07.155269 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:07.155991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:07.156471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lazy-loading 'fault' on Instance uuid c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:20:07.171228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:07.172481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:07.193338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:07.197230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:07.197679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:07.198416 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:07.206010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:07.206456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:07.236437 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700f40b4567a4bcdbb2194861f4497d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480896a54dab43c8980c8b05c9a793e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:07.247180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-14a3f40e-6981-4278-a40a-61d451facc3e tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 200 len: 1311 microversion: 2.1 time: 0.147799 Aug 06 22:20:07.260518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 549/1074] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:07 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 1311 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:07.370627 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:07.385065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:07.386613 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:07.387773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4f2c93c9-830b-4ddd-a4d1-c4073f5d2145 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1744 microversion: 2.20 time: 0.220547 Aug 06 22:20:07.388318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 526/1075] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:07 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:07.719143 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:07.719768 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:07.727362 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:07.727867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:07.728306 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:07.729052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:07.729508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:07.729938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:07.882805 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:07.890604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-97bc2a2c-e7ca-4a8f-9fc0-45ff001c7232 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1681 microversion: 2.1 time: 0.175281 Aug 06 22:20:07.891577 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 550/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:07 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:08.269251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:08.269883 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] [instance: c1fe6d06-81d1-46d4-a10a-54fc6d97cea9] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:08.276309 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:08.276838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:08.277273 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:08.277974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:08.278431 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:08.278860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:08.293163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] HTTP exception thrown: Instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 could not be found. Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Request method failure captured: Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 HTTP/1.1 Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7udZGdKqrZM6ePWm1NQTP4djHVVMKMfpH91VVhsbg1Ih5klYx1TuUmO5tg3BHc8qKERiGXBfZq_1iOaksAzWpgvxzeTUsKZRp1JdHqRnblGCGS9K2_2sWw2sp9H7GvzqWWtb2VQtM3RegT0Qiau3QL0y_a3lxZGidgEP423j_l3VubM Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:20:08.295167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_480896a54dab43c8980c8b05c9a793e7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/480896a54dab43c8980c8b05c9a793e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 480896a54dab43c8980c8b05c9a793e7 Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1014229304 Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 700f40b4567a4bcdbb2194861f4497d5 Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1014229304-project Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 could not be found. Aug 06 22:20:08.299743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': 'c1fe6d06-81d1-46d4-a10a-54fc6d97cea9'} Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 could not be found. Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:20:08.300769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 could not be found. Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 could not be found. Aug 06 22:20:08.302327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:20:08.303705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] Returning 404 to user: Instance c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:20:08.303705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6a34f644-32cc-4a29-b0b9-8713034ba09f tempest-ServerRescueNegativeTestJSON-1014229304 tempest-ServerRescueNegativeTestJSON-1014229304-project] 10.222.0.18 "GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9" status: 404 len: 111 microversion: 2.1 time: 0.032340 Aug 06 22:20:08.303705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 527/1077] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:08 2022] GET /compute/v2.1/servers/c1fe6d06-81d1-46d4-a10a-54fc6d97cea9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:20:08.411731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:08.412263 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:08.420774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:08.421258 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:08.423972 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:08.425057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:08.425529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:08.425983 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:08.715714 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-2f9cca96-93c4-4e19-81df-c752b8812f44 req-4e89fb8b-80a4-4849-bbab-cb6737f0b34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317f93e1-fb8d-4630-aa61-d3232597ddf9", "name": "network-vif-deleted", "tag": "6f569b4a-6fb6-4035-9912-48a14554f341"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:08.739929 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2f9cca96-93c4-4e19-81df-c752b8812f44 req-4e89fb8b-80a4-4849-bbab-cb6737f0b34b service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:08.739929 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2f9cca96-93c4-4e19-81df-c752b8812f44 req-4e89fb8b-80a4-4849-bbab-cb6737f0b34b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:08.741343 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:08.742738 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2f9cca96-93c4-4e19-81df-c752b8812f44 req-4e89fb8b-80a4-4849-bbab-cb6737f0b34b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:08.755219 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:08.757829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:08.759402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9e7c2580-87ea-40d3-a0fc-71477d564f19 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.352190 Aug 06 22:20:08.762126 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 551/1078] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:08 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:08.786982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-2f9cca96-93c4-4e19-81df-c752b8812f44 req-4e89fb8b-80a4-4849-bbab-cb6737f0b34b service nova] Creating event network-vif-deleted:6f569b4a-6fb6-4035-9912-48a14554f341 for instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 on hv-cinder-84984 Aug 06 22:20:08.795943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-2f9cca96-93c4-4e19-81df-c752b8812f44 req-4e89fb8b-80a4-4849-bbab-cb6737f0b34b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091022 Aug 06 22:20:08.796923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 528/1079] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:20:08.915475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:08.916084 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:08.922255 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:08.923024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:08.924141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:08.925134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:08.925807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:08.926444 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:09.046752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:09.056522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-15ed3c54-6b4d-413b-9116-3fa016fde86f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 200 len: 1325 microversion: 2.1 time: 0.145211 Aug 06 22:20:09.058246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 552/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:08 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 1325 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:09.807445 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:09.810754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:09.857906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:09.858656 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:09.864633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:09.865411 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:09.867723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:09.868375 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:09.910911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:10.092023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:10.094191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:10.108804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:10.113950 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:10.115179 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:10.117512 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:10.118419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:10.119236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:10.119896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:10.150918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 HTTP/1.1 Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:20:10.153636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:20:10.154947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '317f93e1-fb8d-4630-aa61-d3232597ddf9'} Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:20:10.155677 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:20:10.156934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:20:10.163964 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:20:10.165394 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f33f50da-e654-474c-9cf5-61bb75420c15 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 404 len: 111 microversion: 2.1 time: 0.078718 Aug 06 22:20:10.166545 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 553/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:10 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:20:10.170323 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:10.186797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:10.190003 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-015034b5-87fe-4d01-8deb-3f653e3d9f5e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '.version_select at 0x7f30c68dbaf0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:10.193346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:10.200603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9df40319-f1d6-4cb5-aa0e-6921111fabc5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.402798 Aug 06 22:20:10.215556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 529/1082] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:09 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:10.375001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-015034b5-87fe-4d01-8deb-3f653e3d9f5e tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-446120663" status: 202 len: 0 microversion: 2.1 time: 0.194721 Aug 06 22:20:10.383034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 554/1083] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Aug 6 22:20:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-446120663 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:20:11.232599 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:11.234149 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:11.246838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:11.251470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:11.252622 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:11.253592 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:11.257018 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:11.257758 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:11.621704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:11.661015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:11.664027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:11.666040 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b3a24359-31be-4f3c-a6f9-275e832fe0d0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.440549 Aug 06 22:20:11.668949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 530/1084] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:11 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:11.743629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a74c896c-9dbf-4ab6-bb7d-f0c3e78744b9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: .version_select at 0x7f30c6abd0d0>, body: {"keypair": {"name": "tempest-keypair-146333207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8VGpvuMrqmANb9s7zfmNL9EljSzJUUHJkRj1YdfeRZsMKCoBBd61+O9La9U1H8RQkbTgDYnePWXjQfuHJbW4eppROL+e6Oa3Fh5yPZOC4ZGhhynY2Krmb7B1w51REWfA=="}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:11.774563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-a74c896c-9dbf-4ab6-bb7d-f0c3e78744b9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for project f4867885fc0d4ca29d2d674465398466. Resources: {'key_pairs'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:20:11.780970 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-a74c896c-9dbf-4ab6-bb7d-f0c3e78744b9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for user 0d6e35038fed4b44b986902a5ef55ce8 and project f4867885fc0d4ca29d2d674465398466. Resources: {'key_pairs'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:20:11.980811 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a74c896c-9dbf-4ab6-bb7d-f0c3e78744b9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.241721 Aug 06 22:20:11.981413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 555/1085] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:20:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:20:12.695489 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:12.697499 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:12.706972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:12.708444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:12.709025 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:12.709986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:12.710743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:12.712715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:13.118146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:13.130347 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:13.132896 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:13.134494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c9e86065-6131-4439-8ad1-a45f102dfcc3 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.446836 Aug 06 22:20:13.135214 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 531/1086] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:12 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:14.160552 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:14.161139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:14.168527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:14.169013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:14.176980 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:14.178434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:14.179090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:14.179695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:14.453786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:14.468370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:14.474753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:14.476183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f1e098f2-ef5b-4041-8e3f-44069080ba90 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.320903 Aug 06 22:20:14.477151 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 556/1087] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:14 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:15.503584 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:15.504973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:15.507775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:15.516665 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:15.517526 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:15.518207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:15.519143 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:15.519874 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:15.520608 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:15.777467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:15.786691 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:15.788364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:15.789793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ffc8729c-b69e-4946-9db5-6bb490887d28 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.290557 Aug 06 22:20:15.790606 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 532/1088] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:15 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:15.999412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1010052288", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15a3ad5d-cae3-43a4-b19f-06f85bc9b5e1"}], "security_groups": [{"name": "tempest-securitygroup--716602948"}], "key_name": "tempest-keypair-146333207", "user_data": "}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:16.145243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] validate_networks() for [('15a3ad5d-cae3-43a4-b19f-06f85bc9b5e1', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:20:16.668194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:20:16.668664 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:20:16.669139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:20:16.669546 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:20:16.669958 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:20:16.681430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:16.682314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:16.683386 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:16.684728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:16.685785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:16.686450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:16.709763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for project f4867885fc0d4ca29d2d674465398466. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:20:16.715254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Getting quotas for user 0d6e35038fed4b44b986902a5ef55ce8 and project f4867885fc0d4ca29d2d674465398466. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:20:16.731915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:20:16.734288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:20:16.813055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:16.813664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:16.839492 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:16.840028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:16.840478 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:16.841179 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:16.841621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:16.846573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:16.873884 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e4ee8769-e94f-4be0-8d45-c60d2d5ba842 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.878869 Aug 06 22:20:16.882174 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 557/1089] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:20:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:20:16.890461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6c4feffa-8c33-4292-8312-27c8b0c3d362 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:16.890461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6c4feffa-8c33-4292-8312-27c8b0c3d362 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:16.968539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6c4feffa-8c33-4292-8312-27c8b0c3d362 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:16.979373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6c4feffa-8c33-4292-8312-27c8b0c3d362 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1241 microversion: 2.1 time: 0.094753 Aug 06 22:20:16.995598 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 558/1090] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:16 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:17.114897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:17.133099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:17.134607 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:17.135813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8c3b4df0-7d81-47d0-adbe-d18b830b7c7b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.327193 Aug 06 22:20:17.136394 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 533/1091] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:16 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:18.002582 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4e89af1e-acb4-43a2-b7be-bc7363d7d061 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:18.003326 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4e89af1e-acb4-43a2-b7be-bc7363d7d061 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:18.057697 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4e89af1e-acb4-43a2-b7be-bc7363d7d061 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:18.065387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4e89af1e-acb4-43a2-b7be-bc7363d7d061 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1241 microversion: 2.1 time: 0.066859 Aug 06 22:20:18.065948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 559/1092] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:17 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:18.163838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:18.164465 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:18.170837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:18.171316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:18.171745 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:18.172448 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:18.172901 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:18.173321 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:18.310911 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:18.320315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:18.322672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:18.326271 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7dea3c58-2042-41cf-9b21-97b70e591e70 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.166110 Aug 06 22:20:18.327140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 534/1093] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:18 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:19.087930 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:19.089228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:19.105859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:19.106365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:19.106856 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:19.107554 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:19.108001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:19.108441 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:19.203847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:19.212610 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c9dfeef3-9bb3-44ab-b541-243236b56ccc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1293 microversion: 2.1 time: 0.128658 Aug 06 22:20:19.218325 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 560/1094] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:19 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1293 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:19.352506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:19.354221 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:19.361249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:19.362015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:19.362634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:19.363331 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:19.363948 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:19.364376 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:19.807342 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:19.825567 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:19.827894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:19.829428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e9adab43-6882-4c7d-8739-d17eb63a6599 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.482744 Aug 06 22:20:19.830271 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 535/1095] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:19 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:20.235747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:20.237601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:20.245667 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:20.246147 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:20.246592 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:20.247279 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:20.247732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:20.248183 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:20.400179 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:20.409737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8012abb0-c35b-4788-8cca-4c2895a1ce81 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1311 microversion: 2.1 time: 0.179451 Aug 06 22:20:20.411320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 561/1096] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:20 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:20.858108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:20.870417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:20.870417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:20.870417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:20.870417 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:20.871075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:20.871075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:20.871075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:21.074845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:21.084365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:21.086459 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:21.088064 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e4de7a97-59b0-441c-96c9-eaf072c002a9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.234924 Aug 06 22:20:21.089377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 536/1097] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:20 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:21.432563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:21.433225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:21.441116 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:21.441649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:21.442207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:21.442967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:21.443415 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:21.443859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:21.581589 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:21.591312 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-250290eb-d1e4-43da-95d3-4033a497ea1f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.162915 Aug 06 22:20:21.591924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 562/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:21 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:22.112446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:22.113208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:22.121538 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:22.122165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:22.122708 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:22.123539 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:22.124112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:22.124697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:22.323207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:22.336637 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:22.338152 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:22.339333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f322215d-ccee-4029-80cc-9280a6b17ca1 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.231013 Aug 06 22:20:22.339873 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 537/1099] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:22 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:22.384955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-80e2f38f-df6e-4f66-b780-c32ccfbe17eb req-a1d23520-d607-4ad8-88ce-f9d6601cacf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e74e654-249d-4a02-87b0-1fd6dade75cf", "tag": "b662e9a3-60ae-4a49-ae9f-1ceeb4fbbfca"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:22.408494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-80e2f38f-df6e-4f66-b780-c32ccfbe17eb req-a1d23520-d607-4ad8-88ce-f9d6601cacf0 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:22.409199 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-80e2f38f-df6e-4f66-b780-c32ccfbe17eb req-a1d23520-d607-4ad8-88ce-f9d6601cacf0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:22.410341 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-80e2f38f-df6e-4f66-b780-c32ccfbe17eb req-a1d23520-d607-4ad8-88ce-f9d6601cacf0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:22.426192 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-80e2f38f-df6e-4f66-b780-c32ccfbe17eb req-a1d23520-d607-4ad8-88ce-f9d6601cacf0 service nova] Creating event network-changed:b662e9a3-60ae-4a49-ae9f-1ceeb4fbbfca for instance 9e74e654-249d-4a02-87b0-1fd6dade75cf on hv-cinder-84984 Aug 06 22:20:22.431741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-80e2f38f-df6e-4f66-b780-c32ccfbe17eb req-a1d23520-d607-4ad8-88ce-f9d6601cacf0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050875 Aug 06 22:20:22.435433 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 563/1100] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:20:22.615204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:22.615733 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:22.628953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:22.629742 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:22.630351 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:22.631225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:22.631847 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:22.632457 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:22.781814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:22.790342 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-db9f6c74-cff4-4ba9-8e40-764824c49b70 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.180612 Aug 06 22:20:22.790934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 538/1101] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:22 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:23.368293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:23.369045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:23.375108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:23.375585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:23.376020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:23.376734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:23.377763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:23.378191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:23.511951 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:23.520642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:23.525504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:23.525504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a475a439-960d-4429-a2e6-c1bf6bab148f tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1739 microversion: 2.20 time: 0.159706 Aug 06 22:20:23.525504 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 564/1102] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:23 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:23.811293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:23.811899 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:23.818505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:23.818979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:23.819406 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:23.820084 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:23.820554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:23.820974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:23.948508 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:23.956329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3ac83e25-8f33-45d6-a392-2de605b71ba5 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.148826 Aug 06 22:20:23.956916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 539/1103] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:23 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:24.546243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:24.546920 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:24.553502 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:24.553978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:24.554404 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:24.555084 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:24.555531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:24.555945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:24.692585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:24.700315 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:24.701932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:24.703072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9f0c3704-d943-41ae-9055-400d1049d7c8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1721 microversion: 2.20 time: 0.160764 Aug 06 22:20:24.703621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 565/1104] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:24 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:24.977987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:24.978595 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:24.985102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:24.987890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:24.987890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:24.987890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:24.987890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:24.988299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:25.114700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:25.122085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a10a6c79-a255-4876-be17-498b812af8a7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.148193 Aug 06 22:20:25.122639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 540/1105] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:24 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:20:25.727688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:25.732652 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:25.734804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:25.735288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:25.735726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:25.736458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:25.736915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:25.737362 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:25.871660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:25.880804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:25.882314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:25.883483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d6a7d175-1425-4a66-b7cc-ad74ef6ec652 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1721 microversion: 2.20 time: 0.159940 Aug 06 22:20:25.884248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 566/1106] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:25 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:26.143162 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:26.145003 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:26.151895 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:26.152379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:26.153029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:26.153923 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:26.154378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:26.154804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:26.292996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:26.302546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b4acf1e4-b134-42bf-946b-c370b428485f tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.163348 Aug 06 22:20:26.303235 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 541/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:26 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:26.907904 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:26.908550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:26.911465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:26.917124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:26.917558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:26.918003 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:26.918701 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:26.919316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:26.919750 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:26.923831 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:27.066672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:27.074603 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:27.076106 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:27.077300 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-04ccd18c-3146-4767-afe3-401ce8348daa tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1721 microversion: 2.20 time: 0.173582 Aug 06 22:20:27.077852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 567/1108] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:26 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:27.323039 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:27.323814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:27.330188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:27.330673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:27.331249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:27.332684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:27.333135 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:27.333588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:27.471624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:27.480099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-97671224-c6a0-44ac-a573-2deedd5a0bf9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.160974 Aug 06 22:20:27.480693 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 542/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:27 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:28.102688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:28.103262 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:28.109427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=14 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:28.110893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:28.111378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:28.111847 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:28.112680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:28.113839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:28.114260 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:28.250689 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:28.258690 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:28.260182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:28.261365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-192f41b0-9b1e-408b-bf1d-592f9f2aea01 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1721 microversion: 2.20 time: 0.163343 Aug 06 22:20:28.261925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 568/1110] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:28 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:20:28.506801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:28.507488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:28.514083 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:28.514597 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:28.515070 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:28.515784 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:28.516243 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:28.516707 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:28.621303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-aa63ac37-d7c8-460c-a1a6-76c267fa57a4 req-a3c56f07-cfc4-46ff-ab7b-3affc70d1f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e74e654-249d-4a02-87b0-1fd6dade75cf", "name": "network-vif-plugged", "status": "completed", "tag": "b662e9a3-60ae-4a49-ae9f-1ceeb4fbbfca"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:28.635055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-aa63ac37-d7c8-460c-a1a6-76c267fa57a4 req-a3c56f07-cfc4-46ff-ab7b-3affc70d1f01 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:28.635538 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-aa63ac37-d7c8-460c-a1a6-76c267fa57a4 req-a3c56f07-cfc4-46ff-ab7b-3affc70d1f01 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:28.635967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-aa63ac37-d7c8-460c-a1a6-76c267fa57a4 req-a3c56f07-cfc4-46ff-ab7b-3affc70d1f01 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:28.649158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-aa63ac37-d7c8-460c-a1a6-76c267fa57a4 req-a3c56f07-cfc4-46ff-ab7b-3affc70d1f01 service nova] Creating event network-vif-plugged:b662e9a3-60ae-4a49-ae9f-1ceeb4fbbfca for instance 9e74e654-249d-4a02-87b0-1fd6dade75cf on hv-cinder-84984 Aug 06 22:20:28.654760 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-aa63ac37-d7c8-460c-a1a6-76c267fa57a4 req-a3c56f07-cfc4-46ff-ab7b-3affc70d1f01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039976 Aug 06 22:20:28.655575 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 569/1111] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:20:28.668651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:28.676567 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4d20639d-92a5-4f90-ab19-511a230e5c7a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.173682 Aug 06 22:20:28.677226 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 543/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:28 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:29.288020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:29.288020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:29.292251 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:29.292837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:29.293354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:29.294128 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:29.294769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:29.295276 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:29.434450 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:29.443660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:29.445281 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:29.446434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-709741de-7ce9-4a33-b3e6-325e3a18acc6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1664 microversion: 2.20 time: 0.166443 Aug 06 22:20:29.447167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 570/1113] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:29 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:29.469979 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bb87bef-6651-4961-84cb-4fa8fd55a020"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:29.472540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:29.478726 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:29.479204 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:29.480005 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:29.480473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:29.480924 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:29.481339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:29.886327 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:29.886971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:29.892904 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:29.893382 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:29.894384 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:29.895087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:29.895519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:29.895938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:30.032019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:30.039739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-266a21bb-ae12-4b48-8eec-16136baabad1 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.345306 Aug 06 22:20:30.045790 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 571/1114] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:29 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:30.260942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:30.641295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a79a2cd4-8135-4d8a-a15a-1975eac63a03 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.175314 Aug 06 22:20:30.641914 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 544/1115] 10.222.0.18 () {62 vars in 1364 bytes} [Sat Aug 6 22:20:29 2022] POST /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/os-volume_attachments => generated 188 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:20:30.669899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-f607fbf3-b630-4353-9665-324c99e90b9f req-5a8f22e9-1d47-43ec-a8f8-9206d928c615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d13c88b-ec4a-4fc4-af59-8fe95949327f", "name": "network-vif-unplugged", "status": "completed", "tag": "69af86b5-7845-4fb4-ad57-44fa19c640b3"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:30.681086 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f607fbf3-b630-4353-9665-324c99e90b9f req-5a8f22e9-1d47-43ec-a8f8-9206d928c615 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:30.681784 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f607fbf3-b630-4353-9665-324c99e90b9f req-5a8f22e9-1d47-43ec-a8f8-9206d928c615 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:30.682213 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-f607fbf3-b630-4353-9665-324c99e90b9f req-5a8f22e9-1d47-43ec-a8f8-9206d928c615 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:30.707778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.compute.server_external_events [req-f607fbf3-b630-4353-9665-324c99e90b9f req-5a8f22e9-1d47-43ec-a8f8-9206d928c615 service nova] Unable to find a host for instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f. Dropping event network-vif-unplugged {{(pid=118457) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 22:20:30.707778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-f607fbf3-b630-4353-9665-324c99e90b9f req-5a8f22e9-1d47-43ec-a8f8-9206d928c615 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034784 Aug 06 22:20:30.707778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 572/1116] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 22:20:30.779087 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:30.779583 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:30.785925 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:30.786404 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:30.786842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:30.787523 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:30.787975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:30.788397 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:31.061855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:31.062674 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:31.069156 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:31.069782 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:31.070314 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:31.071254 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:31.071930 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:31.072496 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:31.210270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:31.217769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3f4746c3-f295-449c-acb8-75069ea45fe6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1366 microversion: 2.1 time: 0.159827 Aug 06 22:20:31.218328 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 573/1117] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:31 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:31.461507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a914317f-bb1c-4b16-b1c2-0f83133ca811 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/os-volume_attachments/6bb87bef-6651-4961-84cb-4fa8fd55a020" status: 202 len: 0 microversion: 2.20 time: 0.682948 Aug 06 22:20:31.461507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 545/1118] 10.222.0.18 () {60 vars in 1457 bytes} [Sat Aug 6 22:20:30 2022] DELETE /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/os-volume_attachments/6bb87bef-6651-4961-84cb-4fa8fd55a020 => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:20:31.521226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:31.521739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:31.527766 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:31.528297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:31.528749 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:31.529441 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:31.529900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:31.530348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:31.559493 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118457) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 22:20:31.769324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-71c15b80-63c6-4abc-92fe-5cda95f1ee07 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "POST /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/action" status: 202 len: 0 microversion: 2.20 time: 0.252162 Aug 06 22:20:31.770240 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 574/1119] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Aug 6 22:20:31 2022] POST /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:20:31.972493 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:31.973358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:31.979354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:31.979970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:31.980418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:31.981105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:31.981557 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:31.981975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:32.121206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:32.129945 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:32.131578 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:32.132646 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-33569416-c0c7-4e09-9a76-3007bb84f2e7 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1672 microversion: 2.20 time: 0.358351 Aug 06 22:20:32.133407 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 546/1120] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:31 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1672 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 22:20:32.239733 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:32.240795 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:32.247711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:32.248260 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:32.249132 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:32.250108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:32.250773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:32.251535 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:32.384139 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:32.392814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-edf54184-a515-4f3d-b8ac-07d1e0e3c2da tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1556 microversion: 2.1 time: 0.157812 Aug 06 22:20:32.393392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 575/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:20:32 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:20:32.418869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:32.419358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:32.425841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:32.426363 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:32.426755 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:32.427490 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:32.427947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:32.428368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:32.507202 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e9abea04-d882-4d0c-aae4-22e33720d7a3 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092244 Aug 06 22:20:32.507821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 547/1122] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Aug 6 22:20:32 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:20:33.155476 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:33.156040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:33.163104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:33.163797 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:33.164224 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:33.164946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:33.165969 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:33.166410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:33.431642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:33.439843 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:33.441881 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:33.443046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a5876f06-88c0-4048-8567-98e9e33f41ea tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1672 microversion: 2.20 time: 0.291810 Aug 06 22:20:33.443612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 576/1123] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:33 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1672 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:33.977099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-c6969120-c8f0-4165-bd80-8ee9c904cf37 req-2f7b28a8-aa5d-4c9f-a58b-1e53df427bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e74e654-249d-4a02-87b0-1fd6dade75cf", "tag": "b662e9a3-60ae-4a49-ae9f-1ceeb4fbbfca"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:33.992333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-c6969120-c8f0-4165-bd80-8ee9c904cf37 req-2f7b28a8-aa5d-4c9f-a58b-1e53df427bbc service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:33.993384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-c6969120-c8f0-4165-bd80-8ee9c904cf37 req-2f7b28a8-aa5d-4c9f-a58b-1e53df427bbc service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:33.994462 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-c6969120-c8f0-4165-bd80-8ee9c904cf37 req-2f7b28a8-aa5d-4c9f-a58b-1e53df427bbc service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:34.016651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-c6969120-c8f0-4165-bd80-8ee9c904cf37 req-2f7b28a8-aa5d-4c9f-a58b-1e53df427bbc service nova] Creating event network-changed:b662e9a3-60ae-4a49-ae9f-1ceeb4fbbfca for instance 9e74e654-249d-4a02-87b0-1fd6dade75cf on hv-cinder-84984 Aug 06 22:20:34.023997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-c6969120-c8f0-4165-bd80-8ee9c904cf37 req-2f7b28a8-aa5d-4c9f-a58b-1e53df427bbc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052080 Aug 06 22:20:34.025170 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 548/1124] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:20:34.466418 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:34.467618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:34.475387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:34.476090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:34.476716 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:34.477773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:34.478376 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:34.478963 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:34.635516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:34.644056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:34.646596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:34.648197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ad34cabf-2348-44ef-b5a8-0b711e867f7a tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.185873 Aug 06 22:20:34.649296 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 577/1125] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:34 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:35.679853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:35.681393 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:35.689595 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:35.690154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:35.691522 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:35.692304 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:35.692965 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:35.693599 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:35.904254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:35.912961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:35.914419 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:35.915576 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0e61594d-79ea-47d4-82b4-87bcb8240d37 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.241802 Aug 06 22:20:35.916140 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 549/1126] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:35 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:36.644735 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:20:36.645055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Sat Aug 6 22:20:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:20:36.941016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:36.941626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:36.949333 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:36.950006 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:36.950593 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:36.951446 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:36.952041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:36.952630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:37.124559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:37.149465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:37.153974 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:37.155201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3d2f8061-c378-468f-9d22-b29852936167 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.218244 Aug 06 22:20:37.159665 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 578/1127] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:36 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:38.182367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:38.189398 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:38.190017 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:38.191290 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:38.191938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:38.192679 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:38.193187 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:38.193601 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:38.390968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:38.400704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:38.402762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:38.404223 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f85b78fb-2da0-4426-86e3-06b3b549f62d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.226201 Aug 06 22:20:38.405023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 550/1128] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:38 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:39.430520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:39.430520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:39.437109 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:39.437672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:39.438018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:39.439033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:39.439613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:39.440764 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:39.610646 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:39.620486 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:39.625391 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:39.629259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-aedb55b3-57ea-4702-a1a0-2fda80313b04 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.200992 Aug 06 22:20:39.629259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 579/1129] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:39 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:40.650270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:40.651042 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:40.659573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:40.663251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:40.663251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:40.663251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:40.663251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:40.663569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:40.807134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:40.815415 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:40.816990 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:40.818167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c9834d6d-e65f-4fd5-a4f4-f78a653c35e0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.172011 Aug 06 22:20:40.818731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 551/1130] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:40 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:41.841242 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:41.841850 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:41.844326 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:41.857910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:41.860774 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:41.861112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:41.865026 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:41.865501 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:41.865936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:42.025296 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:42.034941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:42.036595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:42.037829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cfbd5f9c-0222-42f8-a7f6-5fbcdbf27f18 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.200399 Aug 06 22:20:42.038401 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 580/1131] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:41 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:43.063881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:43.066549 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:43.075084 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:43.079221 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:43.079221 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:43.079221 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:43.079221 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:43.079704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:43.210846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:43.223822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:43.225954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:43.227293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-524abd5b-1692-4ab7-afdd-e2d79abc2323 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.169007 Aug 06 22:20:43.238297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 552/1132] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:43 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:44.253072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:44.254700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:44.264258 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:44.265041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:44.265729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:44.266596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:44.267466 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:44.269057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:44.406776 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:44.415369 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:44.416897 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:44.418081 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cae0ac50-bf84-483d-8cbb-3d9deda0aba0 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.171596 Aug 06 22:20:44.418646 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 581/1133] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:44 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:45.440801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:45.441318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:45.447650 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:45.448122 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:45.448590 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:45.449266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:45.449712 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:45.450133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:45.579479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:45.588111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:45.589668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:45.590816 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-14b9b119-f816-47cd-b66a-e289c274c7d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.154225 Aug 06 22:20:45.591369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 553/1134] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:45 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:46.614754 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:46.615369 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:46.621969 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:46.630390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:46.630390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:46.630390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:46.630390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:46.630787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:46.756520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:46.764589 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:46.766152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:46.770067 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9a785be9-995e-4bb0-a577-e8029c510654 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.156539 Aug 06 22:20:46.770067 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 582/1135] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:46 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:47.790962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:47.791543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:47.793852 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=44 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:47.798732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:47.799244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:47.799668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:47.800347 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:47.800824 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:47.801242 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:47.942376 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:47.950182 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:47.951668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:47.952830 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7d9f3079-0f39-4ed8-86a2-5a8834178d30 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.165850 Aug 06 22:20:47.953378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 554/1136] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:47 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:48.977581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:48.978187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:48.984440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:48.984929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:48.985380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:48.986041 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:48.987195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:48.987638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:49.120386 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:49.128778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:49.130475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:49.131737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-620a728f-503a-4a90-9f6a-6a3990655988 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.158121 Aug 06 22:20:49.132244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 583/1137] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:48 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:50.155041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:50.155563 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:50.162838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:50.163349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:50.163774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:50.164530 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:50.164977 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:50.165391 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:50.300657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:50.308621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:50.311624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:50.311624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-add390ba-762e-45b4-b922-a7d169b5910d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.160267 Aug 06 22:20:50.311852 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 555/1138] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:50 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:51.334726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:51.335327 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:51.341845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:51.342303 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:51.342729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:51.343408 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:51.343851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:51.344266 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:51.348725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:51.474935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:51.482684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:51.484212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:51.485468 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d20cb9d5-e492-4223-87c1-ef995920a9fb tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.154796 Aug 06 22:20:51.486014 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 584/1139] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:51 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:52.509819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:52.510526 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:52.517185 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:52.518240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:52.518680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:52.519383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:52.519837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:52.520261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:52.611948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-d7d82a8b-b381-4918-a93f-452a11e48607 req-0ffd5c31-6d70-449e-ab97-e573219e758f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d13c88b-ec4a-4fc4-af59-8fe95949327f", "name": "network-vif-plugged", "status": "completed", "tag": "69af86b5-7845-4fb4-ad57-44fa19c640b3"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:20:52.622728 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-d7d82a8b-b381-4918-a93f-452a11e48607 req-0ffd5c31-6d70-449e-ab97-e573219e758f service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:52.623209 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-d7d82a8b-b381-4918-a93f-452a11e48607 req-0ffd5c31-6d70-449e-ab97-e573219e758f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:52.624120 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-d7d82a8b-b381-4918-a93f-452a11e48607 req-0ffd5c31-6d70-449e-ab97-e573219e758f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:52.638920 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-d7d82a8b-b381-4918-a93f-452a11e48607 req-0ffd5c31-6d70-449e-ab97-e573219e758f service nova] Creating event network-vif-plugged:69af86b5-7845-4fb4-ad57-44fa19c640b3 for instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f on hv-cinder-84984 Aug 06 22:20:52.646069 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-d7d82a8b-b381-4918-a93f-452a11e48607 req-0ffd5c31-6d70-449e-ab97-e573219e758f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040130 Aug 06 22:20:52.663166 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 585/1140] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:20:52.673371 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:52.681529 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:52.683079 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:52.684239 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5a408dad-5253-4ab7-ab7e-39d839d57d32 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.178464 Aug 06 22:20:52.695859 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 556/1141] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:52 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:53.707612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:53.708306 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:53.715470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:53.715940 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:53.716373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:53.717074 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:53.717521 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:53.717943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:53.849684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:53.857852 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:53.859399 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:53.860622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6389e592-7e56-4bad-8651-51bab4ce2b9d tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.157243 Aug 06 22:20:53.861732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 586/1142] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:53 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:54.883940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:54.884608 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:54.891137 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:54.891621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:54.892055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:54.893428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:54.893949 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:54.894324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:55.026585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:55.034556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:55.036063 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:55.037239 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a2c1de08-88d2-490f-9f3a-acc98e46bf6c tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.157374 Aug 06 22:20:55.037794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 557/1143] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:54 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:56.061320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:56.061921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:56.068434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:56.068918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:56.069354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:56.070055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:56.070506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:56.070931 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:56.204633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:56.213559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:56.215072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:56.216233 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-36ababe2-601b-45dc-a282-ed4b543457d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1730 microversion: 2.20 time: 0.158907 Aug 06 22:20:56.216818 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 587/1144] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:56 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:20:57.240099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:20:57.241344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:20:57.247672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:57.248152 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:57.248621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:57.249311 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:20:57.249841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:20:57.250216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:20:57.382973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:57.382973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:20:57.388872 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:57.390358 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:20:57.391540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d5b97fde-c792-4181-bd08-932552c1b9d5 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1717 microversion: 2.20 time: 0.155953 Aug 06 22:20:57.392086 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 558/1145] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:20:57 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:21:35.159903 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=15 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:21:35.160786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=18 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:21:35.330326 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1ed485b5-173a-4760-8c45-0294907d058e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Action: 'create', calling method: .version_select at 0x7f30c6c64a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-898913352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8qYxVFMnSuMm0KaEuRLLBsun2/w+U0YFctxIs7WXH1THEqgVnoLIQ3o1pzz4tqVsiNV0MRvhwW68wldonI/44eo/B2fVGFJXW2VeVW1FwUMtklCUetpPUpc6wajCgQg=="}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:21:35.346681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-1ed485b5-173a-4760-8c45-0294907d058e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Getting quotas for project 8168ba3e30a743a582d1c182ca2423b3. Resources: {'key_pairs'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:21:35.351093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-1ed485b5-173a-4760-8c45-0294907d058e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Getting quotas for user 2dae6a7ec4404626b75a6702386d091b and project 8168ba3e30a743a582d1c182ca2423b3. Resources: {'key_pairs'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:21:35.468348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1ed485b5-173a-4760-8c45-0294907d058e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.316569 Aug 06 22:21:35.474695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 588/1146] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:21:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:21:46.798270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:46.798270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:46.799167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=9 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:21:46.804252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:46.804821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:46.805261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:46.805950 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:46.806402 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:46.806822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:46.831891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-795242c5-10e7-4eb7-9990-89c1350ec695 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/ips" status: 200 len: 150 microversion: 2.1 time: 0.039866 Aug 06 22:21:46.832696 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 559/1147] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:21:46 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:21:49.468424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=4 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:21:49.469202 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:21:49.473474 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3ba5e2c-edf1-4739-aca3-5f230c757993"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:21:49.478089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:49.481567 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:49.482715 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:49.483204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:49.483894 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:49.484341 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:49.484801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:50.300543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ecdb11b4-c778-4997-8a21-c052445afa18 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "POST /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833129 Aug 06 22:21:50.301146 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 589/1148] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:21:49 2022] POST /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:21:53.039387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:53.041552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:53.049327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:53.049794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:53.050297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:53.050968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:53.051410 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:53.051826 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:53.079909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f22e67fd-2054-409c-8c74-17bf504835d9 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044857 Aug 06 22:21:53.080451 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 560/1149] 10.222.0.18 () {60 vars in 1343 bytes} [Sat Aug 6 22:21:53 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:21:53.142995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:53.143577 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:53.149994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:53.150482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:53.150945 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:53.151693 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:53.152149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:53.152608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:53.177786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:21:53.456294 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-66ed0d1b-7793-4341-a494-4952c20996da tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 204 len: 0 microversion: 2.20 time: 0.318207 Aug 06 22:21:53.456956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 590/1150] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Aug 6 22:21:53 2022] DELETE /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 22:21:53.465259 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:53.465863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:53.472047 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:53.472810 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:53.473241 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:53.473915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:53.474368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:53.474784 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:53.605582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:53.613965 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:53.615446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:53.616644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-55dd5d05-e3c3-43d7-a737-8d1f616d4182 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.155310 Aug 06 22:21:53.617186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 561/1151] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:21:53 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:21:54.639539 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:54.640158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:54.646650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:54.647125 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:54.647551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:54.648227 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:54.648698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:54.649118 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:54.778374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:54.786557 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:54.788476 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:54.789647 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6a523640-7785-4586-b5b3-f58a404926dc tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.154371 Aug 06 22:21:54.790198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 591/1152] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:21:54 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:21:55.814349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:55.815630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:55.822300 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:55.822777 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:55.823209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:55.823934 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:55.824386 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:55.824832 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:55.962109 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:55.971603 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:55.973744 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:55.975291 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-38da0ce8-55c8-49b1-b23f-b6981dcb2aca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1723 microversion: 2.20 time: 0.165228 Aug 06 22:21:55.977712 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 562/1153] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:21:55 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:21:56.694955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-a0522d6e-abf6-418c-b3f5-00047b638a79 req-42c61d17-766f-4b6f-9315-c1be9c3615be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d13c88b-ec4a-4fc4-af59-8fe95949327f", "name": "network-vif-deleted", "tag": "69af86b5-7845-4fb4-ad57-44fa19c640b3"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:21:56.705541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-a0522d6e-abf6-418c-b3f5-00047b638a79 req-42c61d17-766f-4b6f-9315-c1be9c3615be service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:56.706007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-a0522d6e-abf6-418c-b3f5-00047b638a79 req-42c61d17-766f-4b6f-9315-c1be9c3615be service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:56.706439 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-a0522d6e-abf6-418c-b3f5-00047b638a79 req-42c61d17-766f-4b6f-9315-c1be9c3615be service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:56.727670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-a0522d6e-abf6-418c-b3f5-00047b638a79 req-42c61d17-766f-4b6f-9315-c1be9c3615be service nova] Creating event network-vif-deleted:69af86b5-7845-4fb4-ad57-44fa19c640b3 for instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f on hv-cinder-84984 Aug 06 22:21:56.733943 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-a0522d6e-abf6-418c-b3f5-00047b638a79 req-42c61d17-766f-4b6f-9315-c1be9c3615be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101180 Aug 06 22:21:56.739261 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 592/1154] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:21:56.997898 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:56.998513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:57.006251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:57.010505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:57.010505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:57.010505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:57.010505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:57.011043 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:57.083469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:57.091429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:57.092935 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:57.094050 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1f05af30-5d8f-4c73-bae7-e1c3f300c5b8 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1366 microversion: 2.20 time: 0.100053 Aug 06 22:21:57.094598 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 563/1155] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:21:56 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:21:58.118266 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:58.119052 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:58.125302 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:58.125783 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:58.126217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:58.127432 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:58.127941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:58.128366 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:58.161755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:58.162231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:58.162660 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:58.163100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lazy-loading 'fault' on Instance uuid 2d13c88b-ec4a-4fc4-af59-8fe95949327f {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:21:58.204701 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:58.213309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:58.214807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dfc4de8c76d0470a892dc8bad4d29441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e000f22d8284f6ea2178aa17dc70151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:21:58.215938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-79d0f3bc-df5c-43f0-b430-180a6c77b35b tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 200 len: 1371 microversion: 2.20 time: 0.102416 Aug 06 22:21:58.216495 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 593/1156] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:21:58 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 22:21:59.001263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:59.001263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:59.001263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:59.001263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:59.002136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:59.002136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:59.002136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:59.002136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:59.076026 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lazy-loading 'services' on Instance uuid 9e74e654-249d-4a02-87b0-1fd6dade75cf {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:21:59.239996 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:59.240663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:59.247290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:59.247775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:59.248236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:59.248942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:59.249390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:59.249808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:59.263145 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] HTTP exception thrown: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Request method failure captured: Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f HTTP/1.1 Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubYc6G-LrYVvxMTTPhkwzVcFU3W6Wuc3EqBK93P811l-jySKL8WQuarmermUCAm3khikjD5Po5aZnU_O6pnObIWiyzrxv-xa1s7l6L4a_ZL-d5WzgH0er05HAyvUftnovm-alayqQYGR9zWP4Iste138Rx0HxgZbcdRvZszP05od4o Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:21:59.264812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e000f22d8284f6ea2178aa17dc70151", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: dfc4de8c76d0470a892dc8bad4d29441 Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:21:59.266558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '2d13c88b-ec4a-4fc4-af59-8fe95949327f'} Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:21:59.267926 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:21:59.269627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:21:59.271045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Returning 404 to user: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:21:59.271045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-452ccf46-2c96-4210-84ce-9d1306b886ae tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 404 len: 111 microversion: 2.20 time: 0.030718 Aug 06 22:21:59.271045 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 594/1157] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:21:59 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 06 22:21:59.275503 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1cb1a7f3-a37b-4009-9989-b10a001da925 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '.version_select at 0x7f30c69fc1f0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:59.278429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-02fbe2e7-72e8-43cd-aa7c-3fd8e5390ff7 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments/a3ba5e2c-edf1-4739-aca3-5f230c757993" status: 202 len: 0 microversion: 2.1 time: 0.294685 Aug 06 22:21:59.279013 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 564/1158] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:21:58 2022] DELETE /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments/a3ba5e2c-edf1-4739-aca3-5f230c757993 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:21:59.288725 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:21:59.291175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:21:59.297518 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:59.297997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:59.298429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:59.299411 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:21:59.299871 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:21:59.300297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:21:59.328490 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-cd70ba70-5ad9-41d5-a8b7-3581d6d9c8dc tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045145 Aug 06 22:21:59.329036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 565/1159] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:21:59 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:21:59.388578 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1cb1a7f3-a37b-4009-9989-b10a001da925 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869969858" status: 204 len: 0 microversion: 2.20 time: 0.116453 Aug 06 22:21:59.389157 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 595/1160] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Aug 6 22:21:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869969858 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 22:22:00.341512 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:00.343699 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:00.350902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:00.351384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:00.351813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:00.352549 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:00.352997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:00.353664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:00.385191 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7d6e1f9f-f4d0-4264-9634-23b55bf602f9 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Aug 06 22:22:00.385728 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 566/1161] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:22:00 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:01.355430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1116182739", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898913352", "security_groups": [{"name": "tempest-secgroup-smoke-304693870"}], "block_device_mapping_v2": [{"uuid": "ae87ee63-66f4-4348-8c00-513c605dea3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "356b570d-9374-438e-9b29-c0fd0612d386"}]}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:01.397429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:01.399575 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:01.405835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.406316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.406749 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.407438 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.407916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.408447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.437561 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-45182535-0c48-4bc8-bad1-b0bc3c241e43 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043983 Aug 06 22:22:01.443755 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 567/1162] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:22:01 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 22:22:01.474067 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] validate_networks() for [('356b570d-9374-438e-9b29-c0fd0612d386', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:22:01.478836 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:01.479329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:01.485466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.486943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.487521 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.488666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.489278 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.489838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.507909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] HTTP exception thrown: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Request method failure captured: Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: DELETE /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f HTTP/1.1 Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubYc6G-LrYVvxMTTPhkwzVcFU3W6Wuc3EqBK93P811l-jySKL8WQuarmermUCAm3khikjD5Po5aZnU_O6pnObIWiyzrxv-xa1s7l6L4a_ZL-d5WzgH0er05HAyvUftnovm-alayqQYGR9zWP4Iste138Rx0HxgZbcdRvZszP05od4o Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:01.510147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e000f22d8284f6ea2178aa17dc70151", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: dfc4de8c76d0470a892dc8bad4d29441 Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:01.511596 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '2d13c88b-ec4a-4fc4-af59-8fe95949327f'} Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:01.512369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:01.513700 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:01.515080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Returning 404 to user: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:01.515080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-40ead21a-5bdf-42d1-97af-1961776f73ca tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 404 len: 111 microversion: 2.20 time: 0.036479 Aug 06 22:22:01.515080 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 568/1163] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Aug 6 22:22:01 2022] DELETE /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 06 22:22:01.517184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:01.521120 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:01.524032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.524615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.525052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.525745 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.526194 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.526642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.553542 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:22:01.857907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:22:01.858320 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:22:01.858855 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:22:01.859753 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:22:01.863407 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:22:01.873808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.874463 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.874988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.875750 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.876304 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.876804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.894321 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Getting quotas for project 8168ba3e30a743a582d1c182ca2423b3. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:22:01.898242 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Getting quotas for user 2dae6a7ec4404626b75a6702386d091b and project 8168ba3e30a743a582d1c182ca2423b3. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:22:01.956309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:22:01.958485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae87ee63-66f4-4348-8c00-513c605dea3d',volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:22:01.974573 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9d197572-e62b-4aaa-935d-dcba569b4372 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 204 len: 0 microversion: 2.1 time: 0.460858 Aug 06 22:22:01.975244 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 569/1164] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:22:01 2022] DELETE /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:22:01.982947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:01.982947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 2d13c88b-ec4a-4fc4-af59-8fe95949327f] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:01.987982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.988478 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.988909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:01.989593 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:01.990035 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:01.990450 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:02.003777 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] HTTP exception thrown: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Request method failure captured: Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f HTTP/1.1 Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubYc6G-LrYVvxMTTPhkwzVcFU3W6Wuc3EqBK93P811l-jySKL8WQuarmermUCAm3khikjD5Po5aZnU_O6pnObIWiyzrxv-xa1s7l6L4a_ZL-d5WzgH0er05HAyvUftnovm-alayqQYGR9zWP4Iste138Rx0HxgZbcdRvZszP05od4o Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:02.005421 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e000f22d8284f6ea2178aa17dc70151", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: dfc4de8c76d0470a892dc8bad4d29441 Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:02.007559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '2d13c88b-ec4a-4fc4-af59-8fe95949327f'} Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:02.008316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. Aug 06 22:22:02.010705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:02.012192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Returning 404 to user: Instance 2d13c88b-ec4a-4fc4-af59-8fe95949327f could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:02.012192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-741f4d20-fddf-441b-bbfe-21e0a288b489 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f" status: 404 len: 111 microversion: 2.20 time: 0.030423 Aug 06 22:22:02.012192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 570/1165] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:22:01 2022] GET /compute/v2.1/servers/2d13c88b-ec4a-4fc4-af59-8fe95949327f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:22:02.012192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:02.012192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:02.017932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:02.018408 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:02.018834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:02.019510 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:02.019953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:02.020377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:02.157036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:02.165157 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1a2ca42d-b181-4eaa-a27c-8d7524347512 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1681 microversion: 2.1 time: 0.156970 Aug 06 22:22:02.178834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 571/1166] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:02 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:02.446096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b88887c8-e540-44b0-8d24-a89113e0c7b9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.095114 Aug 06 22:22:02.447106 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 596/1167] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:22:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:22:02.458387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-924919e9-c20f-4744-8444-4e6a5d834a67 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:02.459607 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-924919e9-c20f-4744-8444-4e6a5d834a67 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:02.531000 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-924919e9-c20f-4744-8444-4e6a5d834a67 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:02.537921 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-924919e9-c20f-4744-8444-4e6a5d834a67 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1094 microversion: 2.1 time: 0.084003 Aug 06 22:22:02.538447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 572/1168] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:02 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:03.186562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:03.187122 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:03.193981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:03.194457 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:03.194912 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:03.195591 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:03.196035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:03.196475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:03.323475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:03.331666 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-aee1dbc2-a810-44e2-8194-187b2b1b8750 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1681 microversion: 2.1 time: 0.149118 Aug 06 22:22:03.332225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 597/1169] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:03 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:03.369403 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:03.369931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:03.376467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:03.377520 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:03.377953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:03.378639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:03.379089 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:03.379624 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:03.393673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] HTTP exception thrown: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Request method failure captured: Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: DELETE /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 HTTP/1.1 Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubYc6G-LrYVvxMTTPhkwzVcFU3W6Wuc3EqBK93P811l-jySKL8WQuarmermUCAm3khikjD5Po5aZnU_O6pnObIWiyzrxv-xa1s7l6L4a_ZL-d5WzgH0er05HAyvUftnovm-alayqQYGR9zWP4Iste138Rx0HxgZbcdRvZszP05od4o Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:03.395334 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e000f22d8284f6ea2178aa17dc70151", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: dfc4de8c76d0470a892dc8bad4d29441 Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.397036 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '209d7c8e-59b6-4313-a518-a2c8c7eeb290'} Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:03.397984 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.399439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.400961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Returning 404 to user: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:03.400961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8f5ff3db-d038-4ef4-95a9-c973632260a6 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 404 len: 111 microversion: 2.20 time: 0.031257 Aug 06 22:22:03.400961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 573/1170] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Aug 6 22:22:03 2022] DELETE /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:22:03.405293 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:03.405921 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] [instance: 209d7c8e-59b6-4313-a518-a2c8c7eeb290] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:03.412727 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:03.413204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:03.413636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:03.414316 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:03.414763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:03.415182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:03.428238 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] HTTP exception thrown: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Request method failure captured: Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 HTTP/1.1 Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubYc6G-LrYVvxMTTPhkwzVcFU3W6Wuc3EqBK93P811l-jySKL8WQuarmermUCAm3khikjD5Po5aZnU_O6pnObIWiyzrxv-xa1s7l6L4a_ZL-d5WzgH0er05HAyvUftnovm-alayqQYGR9zWP4Iste138Rx0HxgZbcdRvZszP05od4o Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:22:03.429812 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e000f22d8284f6ea2178aa17dc70151", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e000f22d8284f6ea2178aa17dc70151"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 8e000f22d8284f6ea2178aa17dc70151 Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1450491427 Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: dfc4de8c76d0470a892dc8bad4d29441 Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1450491427-project Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.431487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '209d7c8e-59b6-4313-a518-a2c8c7eeb290'} Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:03.432482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. Aug 06 22:22:03.439046 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:03.440915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] Returning 404 to user: Instance 209d7c8e-59b6-4313-a518-a2c8c7eeb290 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:03.440915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6493d6b3-7276-44ff-b123-b1b5e98af025 tempest-AttachVolumeShelveTestJSON-1450491427 tempest-AttachVolumeShelveTestJSON-1450491427-project] 10.222.0.18 "GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290" status: 404 len: 111 microversion: 2.20 time: 0.029760 Aug 06 22:22:03.440915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 598/1171] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Aug 6 22:22:03 2022] GET /compute/v2.1/servers/209d7c8e-59b6-4313-a518-a2c8c7eeb290 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 22:22:03.557929 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:03.558565 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:03.565555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:03.566029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:03.569840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:03.569840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:03.569840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:03.569840 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:03.642292 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:03.650074 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bd115cf3-69c1-454b-8e4d-ac058b8c6c39 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1144 microversion: 2.1 time: 0.096004 Aug 06 22:22:03.650633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 574/1172] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:03 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:04.355946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:04.356602 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:04.363680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:04.366820 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:04.366820 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:04.366820 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:04.366820 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:04.367247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:04.500653 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:04.511120 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0ab61298-08ec-4ff5-a970-0eb3d2cefeac tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1681 microversion: 2.1 time: 0.159117 Aug 06 22:22:04.511120 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 599/1173] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:04 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:04.670845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:04.671695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:04.678657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:04.679496 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:04.680139 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:04.680967 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:04.681418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:04.682197 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:04.758485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:04.766602 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-facf8a0e-f965-4315-8bfa-8776413bf045 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1192 microversion: 2.1 time: 0.099662 Aug 06 22:22:04.780430 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 575/1174] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:04 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:05.530411 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:05.531913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:05.539546 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:05.540039 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:05.540566 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:05.541338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:05.541801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:05.542225 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:05.613464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:05.621445 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-837f70c4-de31-4671-8fbd-04d6de5f9139 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1614 microversion: 2.1 time: 0.095124 Aug 06 22:22:05.622016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 600/1175] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:05 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:22:05.796894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:05.801517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:05.805428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:05.805909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:05.806360 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:05.807053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:05.807685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:05.808259 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:05.824616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:05.883539 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:05.893203 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-20998dc6-5061-4cf2-a6b2-4c33b2f1a41f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1210 microversion: 2.1 time: 0.099884 Aug 06 22:22:05.893780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 576/1176] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:05 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:06.062182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-73ab2992-1434-4ec3-8f3c-207f04e1c119 req-086b9ee7-12b4-4125-a720-0009424e1d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e74e654-249d-4a02-87b0-1fd6dade75cf", "name": "network-vif-deleted", "tag": "b662e9a3-60ae-4a49-ae9f-1ceeb4fbbfca"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:06.087802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-73ab2992-1434-4ec3-8f3c-207f04e1c119 req-086b9ee7-12b4-4125-a720-0009424e1d07 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:06.089055 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-73ab2992-1434-4ec3-8f3c-207f04e1c119 req-086b9ee7-12b4-4125-a720-0009424e1d07 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:06.096440 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-73ab2992-1434-4ec3-8f3c-207f04e1c119 req-086b9ee7-12b4-4125-a720-0009424e1d07 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:06.117229 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-73ab2992-1434-4ec3-8f3c-207f04e1c119 req-086b9ee7-12b4-4125-a720-0009424e1d07 service nova] Creating event network-vif-deleted:b662e9a3-60ae-4a49-ae9f-1ceeb4fbbfca for instance 9e74e654-249d-4a02-87b0-1fd6dade75cf on hv-cinder-84984 Aug 06 22:22:06.130021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-73ab2992-1434-4ec3-8f3c-207f04e1c119 req-086b9ee7-12b4-4125-a720-0009424e1d07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072681 Aug 06 22:22:06.133256 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 601/1177] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:06.646590 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:06.647634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:06.661675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:06.664702 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:06.667644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:06.667644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:06.667644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:06.668882 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:06.740494 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:06.741249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:06.741850 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:06.742992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lazy-loading 'fault' on Instance uuid 9e74e654-249d-4a02-87b0-1fd6dade75cf {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:22:06.817687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6e35038fed4b44b986902a5ef55ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4867885fc0d4ca29d2d674465398466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:06.836387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-74256fb9-533a-4ef4-a84b-5c84bdf6c192 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 200 len: 1331 microversion: 2.1 time: 0.196118 Aug 06 22:22:06.838813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 577/1178] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:06 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 1331 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:06.920068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:06.920848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:06.943664 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:06.950144 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:06.950533 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:06.951290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:06.956360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:06.956887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:07.297795 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:07.309138 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1bef800c-5016-4d04-bc64-6891a6e77e94 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.398866 Aug 06 22:22:07.311267 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 602/1179] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:06 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:07.858872 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:07.859502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:07.866962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:07.867553 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:07.868207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:07.869136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:07.869594 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:07.870200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:07.884687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf HTTP/1.1 Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:07.886228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:07.887582 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '9e74e654-249d-4a02-87b0-1fd6dade75cf'} Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:07.888588 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:07.889812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:07.890992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:07.890992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-51d8650c-5419-4674-b51a-d9ba8b0d570b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 404 len: 111 microversion: 2.1 time: 0.032939 Aug 06 22:22:07.891639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 578/1180] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:07 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:07.896718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-930541f7-cc93-48fb-8dda-3c6c8576d019 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '.version_select at 0x7f30c6d4c700>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:08.026516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-930541f7-cc93-48fb-8dda-3c6c8576d019 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-146333207" status: 202 len: 0 microversion: 2.1 time: 0.133622 Aug 06 22:22:08.028618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 603/1181] 10.222.0.18 () {58 vars in 1218 bytes} [Sat Aug 6 22:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-146333207 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:22:08.159422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-43bb5900-2c24-448b-9f56-a318c350f0f7 req-8c98c369-ad69-4eaf-a035-708c06172ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6555e5ac-2ba8-4674-997b-e738b6ff64ed", "tag": "7a1af422-e9c2-4251-bfd8-5ab46189e6b8"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:08.169485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-43bb5900-2c24-448b-9f56-a318c350f0f7 req-8c98c369-ad69-4eaf-a035-708c06172ecb service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:08.170836 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-43bb5900-2c24-448b-9f56-a318c350f0f7 req-8c98c369-ad69-4eaf-a035-708c06172ecb service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:08.170836 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-43bb5900-2c24-448b-9f56-a318c350f0f7 req-8c98c369-ad69-4eaf-a035-708c06172ecb service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:08.182957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-43bb5900-2c24-448b-9f56-a318c350f0f7 req-8c98c369-ad69-4eaf-a035-708c06172ecb service nova] Creating event network-changed:7a1af422-e9c2-4251-bfd8-5ab46189e6b8 for instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed on hv-cinder-84984 Aug 06 22:22:08.187995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-43bb5900-2c24-448b-9f56-a318c350f0f7 req-8c98c369-ad69-4eaf-a035-708c06172ecb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034356 Aug 06 22:22:08.189369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 579/1182] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:08.336149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:08.336885 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:08.345984 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:08.346934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:08.347886 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:08.349564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:08.350237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:08.351761 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:08.601313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:08.615767 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-52f1b151-060d-4e2f-86e6-101bdda0a8e3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.283743 Aug 06 22:22:08.629218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 604/1183] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:08 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:09.638762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:09.640006 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:09.659519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:09.660215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:09.660850 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:09.661736 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:09.662357 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:09.662778 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:09.806783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:09.816382 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7ff04b90-ce54-406a-82cc-e0aaa6ef408f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.182523 Aug 06 22:22:09.817189 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 580/1184] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:09 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:10.753599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:10.754096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:10.760621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:10.761112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:10.761550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:10.762247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:10.762704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:10.763133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:10.776908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf HTTP/1.1 Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:22:10.778616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.780349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '9e74e654-249d-4a02-87b0-1fd6dade75cf'} Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:10.781807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.783330 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.784928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:10.786181 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9fb1ce25-4520-4912-bec7-5d1f35e07a85 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 404 len: 111 microversion: 2.1 time: 0.037346 Aug 06 22:22:10.786743 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 605/1185] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:22:10 2022] DELETE /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:10.794642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:10.801716 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 9e74e654-249d-4a02-87b0-1fd6dade75cf] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:10.801869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:10.802355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:10.802781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:10.803464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:10.803908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:10.804324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:10.818178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf HTTP/1.1 Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:10.819881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.821506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '9e74e654-249d-4a02-87b0-1fd6dade75cf'} Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:10.822418 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. Aug 06 22:22:10.823912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:10.825913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 9e74e654-249d-4a02-87b0-1fd6dade75cf could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:10.825913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b836a2be-ea4d-48e0-bef3-17a69b5056e6 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf" status: 404 len: 111 microversion: 2.1 time: 0.030489 Aug 06 22:22:10.825913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 581/1186] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:10 2022] GET /compute/v2.1/servers/9e74e654-249d-4a02-87b0-1fd6dade75cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:10.842287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:10.842287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:10.845360 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:10.845899 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:10.846324 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:10.847007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:10.847711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:10.848127 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:10.997910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:11.006793 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c9e5eecc-efdd-4a67-92af-87742faecb07 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.171739 Aug 06 22:22:11.007354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 606/1187] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:10 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:12.027906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:12.028623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:12.035891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.036304 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.036760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.037444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.037894 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.038316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.120902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:12.120902 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:12.126273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:12.127897 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=6 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:12.129515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.130149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.130758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.131835 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.132344 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.132796 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.147028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 HTTP/1.1 Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:22:12.148612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.150220 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '317f93e1-fb8d-4630-aa61-d3232597ddf9'} Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:12.151159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.152636 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.154153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:12.154153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-549f4237-fb26-45f0-ab2c-60dcaa4abb6b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 404 len: 111 microversion: 2.1 time: 0.041131 Aug 06 22:22:12.154153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 607/1188] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:22:12 2022] DELETE /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 22:22:12.158917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:12.159517 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 317f93e1-fb8d-4630-aa61-d3232597ddf9] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:12.165541 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.166026 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.166658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.167178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.167622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.168036 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.181586 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.182293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 HTTP/1.1 Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:22:12.183090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.184775 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '317f93e1-fb8d-4630-aa61-d3232597ddf9'} Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:12.185632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. Aug 06 22:22:12.187129 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.188462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 317f93e1-fb8d-4630-aa61-d3232597ddf9 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:12.188462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-43d521a1-d244-479a-9f92-e8cd45e84e53 tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9" status: 404 len: 111 microversion: 2.1 time: 0.029912 Aug 06 22:22:12.188462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 608/1189] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:12 2022] GET /compute/v2.1/servers/317f93e1-fb8d-4630-aa61-d3232597ddf9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:12.193178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:12.193721 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:12.194476 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-92790114-c6d9-4b8d-bb08-9fd8bb459057 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.170400 Aug 06 22:22:12.195035 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 582/1190] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:12 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:12.199632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.201018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.201018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.201332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.201783 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.202235 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.216184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 HTTP/1.1 Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:22:12.217752 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.219402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '590d6f69-cea6-4299-8686-493f521c1e49'} Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:12.220875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.222579 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.224112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:12.224112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-06e3168b-1232-440d-85dc-1db848dfc7bb tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 404 len: 111 microversion: 2.1 time: 0.029871 Aug 06 22:22:12.224112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 609/1191] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:22:12 2022] DELETE /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 22:22:12.228856 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:12.229488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 590d6f69-cea6-4299-8686-493f521c1e49] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:12.235558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.236034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.236528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.237207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:12.237649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:12.238061 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:12.251055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 HTTP/1.1 Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:12.253128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.259780 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '590d6f69-cea6-4299-8686-493f521c1e49'} Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:12.261176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. Aug 06 22:22:12.262680 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:12.263992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 590d6f69-cea6-4299-8686-493f521c1e49 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:12.263992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fb8a346c-570c-4dfd-91ec-9345e4fd442a tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49" status: 404 len: 111 microversion: 2.1 time: 0.029815 Aug 06 22:22:12.263992 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 583/1192] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:12 2022] GET /compute/v2.1/servers/590d6f69-cea6-4299-8686-493f521c1e49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:13.221599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:13.227043 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:13.238606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:13.240098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:13.240767 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:13.241597 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:13.242100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:13.242606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:13.247355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:13.417197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:13.432563 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a8afcc12-e72a-44b1-b207-f668c367799c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.216900 Aug 06 22:22:13.433148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 610/1193] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:13 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:13.646951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:13.647732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:13.649939 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:13.655660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:13.656217 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:13.656747 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:13.658455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:13.658983 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:13.659565 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:13.674842 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: DELETE /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed HTTP/1.1 Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:13.676639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.678252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '56213f38-4e86-47ad-b1df-7734464598ed'} Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:13.679154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.680861 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.682366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:13.682366 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c782cedb-e442-48ba-ab87-4e6e829570ff tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "DELETE /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 404 len: 111 microversion: 2.1 time: 0.037043 Aug 06 22:22:13.686695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 584/1194] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:22:13 2022] DELETE /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:13.691700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:13.692306 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] [instance: 56213f38-4e86-47ad-b1df-7734464598ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:13.699810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:13.700355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:13.700839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:13.701704 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:13.702309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:13.705933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] HTTP exception thrown: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Request method failure captured: Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed HTTP/1.1 Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7ubVMw3XNQg5GKc8Yx2ZZF__hLmRnzvJEkIHgpvNb6ajiP7aB9PNcbT1QZEPHiTBw91_w8dbo4iLWErwfVa6z8CC4oJUIbKcCFU-ZhbywFQnt3l-uYJ8f00xk-Dxo8K5gVsqX4CGSZl8ng2Iflh90Sc2KmjcXPAVRgMnXAJE1Ar7FM8 Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:22:13.728731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4867885fc0d4ca29d2d674465398466", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4867885fc0d4ca29d2d674465398466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: f4867885fc0d4ca29d2d674465398466 Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1628752203 Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 0d6e35038fed4b44b986902a5ef55ce8 Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeNegativeTest-1628752203-project Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.730175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '56213f38-4e86-47ad-b1df-7734464598ed'} Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:13.730922 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. Aug 06 22:22:13.732180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:13.733625 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] Returning 404 to user: Instance 56213f38-4e86-47ad-b1df-7734464598ed could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:13.733625 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-818b3ff9-885a-4b7a-affc-605452b3622b tempest-AttachVolumeNegativeTest-1628752203 tempest-AttachVolumeNegativeTest-1628752203-project] 10.222.0.18 "GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed" status: 404 len: 111 microversion: 2.1 time: 0.040492 Aug 06 22:22:13.733625 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 611/1195] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:13 2022] GET /compute/v2.1/servers/56213f38-4e86-47ad-b1df-7734464598ed => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:14.455846 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:14.457720 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:14.473975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:14.474660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:14.475269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:14.476031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:14.477215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:14.477951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:14.683727 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:14.695319 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ecfbe3af-dd59-4a1f-ba80-39493e4b2527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.245664 Aug 06 22:22:14.709967 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 585/1196] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:14 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:15.725892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:15.729279 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:15.739933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:15.740689 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:15.741755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:15.743125 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:15.743782 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:15.744864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:15.914425 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:15.931527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7a27e332-d76b-4f00-8f7f-361e39191263 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.217321 Aug 06 22:22:15.932109 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 612/1197] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:15 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:16.956696 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:16.957320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:16.968006 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:16.968550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:16.968998 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:16.969786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:16.970524 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:16.971098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:17.331304 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:17.339429 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2ad5a5c7-04fe-4214-abac-558a1a10c3bb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.387860 Aug 06 22:22:17.340106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 586/1198] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:16 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:17.836634 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2e03b9dc-027e-4422-bd19-29724d552f1e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'create', calling method: .version_select at 0x7f30c6b27160>, body: {"keypair": {"name": "tempest-keypair-1848524737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1RHD2BsYBj2dSzEUhGjPz8kxEfWVZm00l5B/9uR7gmR3xxfRv6iCUcguBYA5AQlR/wILOawAUroVHxbNklTz3IiNKBwiHneltSrigNXeGnldvcfK7YuZsdPCVvtCnCnw=="}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:17.852932 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-2e03b9dc-027e-4422-bd19-29724d552f1e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Getting quotas for project 8abd60d3224e4e2995d55417a73ffe58. Resources: {'key_pairs'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:22:17.859546 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-2e03b9dc-027e-4422-bd19-29724d552f1e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Getting quotas for user 563808cf212c40e2bd7f3ace5d1aec03 and project 8abd60d3224e4e2995d55417a73ffe58. Resources: {'key_pairs'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:22:17.965544 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2e03b9dc-027e-4422-bd19-29724d552f1e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277214 Aug 06 22:22:17.972850 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 613/1199] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:22:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:18.379793 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:18.385664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:18.398666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:18.398666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:18.398666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:18.398666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:18.399445 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:18.399445 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:18.621026 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:18.630116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a899fa7f-d4e6-4a1c-8aba-f4757656e9bc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.271293 Aug 06 22:22:18.644540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 587/1200] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:18 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:19.652062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:19.653621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:19.663546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:19.664037 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:19.664507 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:19.665238 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:19.665715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:19.672999 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:19.757564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-82688509-3e25-4f6a-8766-7d1852a1942a req-403369f1-8ca9-4a08-a870-b316a11a35a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6555e5ac-2ba8-4674-997b-e738b6ff64ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a1af422-e9c2-4251-bfd8-5ab46189e6b8"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:19.773809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:19.787809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-82688509-3e25-4f6a-8766-7d1852a1942a req-403369f1-8ca9-4a08-a870-b316a11a35a3 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:19.788627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-82688509-3e25-4f6a-8766-7d1852a1942a req-403369f1-8ca9-4a08-a870-b316a11a35a3 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:19.792353 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-82688509-3e25-4f6a-8766-7d1852a1942a req-403369f1-8ca9-4a08-a870-b316a11a35a3 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:19.820773 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-82688509-3e25-4f6a-8766-7d1852a1942a req-403369f1-8ca9-4a08-a870-b316a11a35a3 service nova] Creating event network-vif-plugged:7a1af422-e9c2-4251-bfd8-5ab46189e6b8 for instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed on hv-cinder-84984 Aug 06 22:22:19.833441 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-82688509-3e25-4f6a-8766-7d1852a1942a req-403369f1-8ca9-4a08-a870-b316a11a35a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367543 Aug 06 22:22:19.834557 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 614/1201] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:22:19.983530 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:19.991999 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-46236b23-9721-4a80-b556-f8c19d71391d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.344735 Aug 06 22:22:19.995858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 588/1202] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:19 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:22:20.853010 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e5e96feb-3f32-4826-9ef6-96d221d9da0d tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Action: 'create', calling method: .version_select at 0x7f30c6a80160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1649199420"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:21.013098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:21.013703 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:21.021061 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:21.021543 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:21.021965 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:21.022884 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:21.023326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:21.023939 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:21.165067 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:21.173909 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b2d4a0d2-bb6c-4505-a7ee-0bc85eb1b677 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.164492 Aug 06 22:22:21.174540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 589/1203] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:21 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:22:21.180279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1479184398", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b511bb86-dd65-46c9-bae6-b443acb1d0b4"}], "security_groups": [{"name": "tempest-securitygroup--1531450883"}], "key_name": "tempest-keypair-1848524737", "user_data": "}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:21.285440 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] validate_networks() for [('b511bb86-dd65-46c9-bae6-b443acb1d0b4', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:22:21.683978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:22:21.684433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:22:21.685380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:22:21.686029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:22:21.686513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:22:21.697819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:21.699024 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:21.699667 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:21.700672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:21.701136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:21.701563 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:21.708822 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e5e96feb-3f32-4826-9ef6-96d221d9da0d tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.998962 Aug 06 22:22:21.709756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 615/1204] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Aug 6 22:22:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1001 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 06 22:22:21.721836 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-77671348-578a-4ebb-bd24-33f2f33a95da tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c68451f0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:21.724014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Getting quotas for project 8abd60d3224e4e2995d55417a73ffe58. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:22:21.728907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Getting quotas for user 563808cf212c40e2bd7f3ace5d1aec03 and project 8abd60d3224e4e2995d55417a73ffe58. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:22:21.740723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:22:21.743206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:22:21.776781 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-77671348-578a-4ebb-bd24-33f2f33a95da tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268" status: 200 len: 345 microversion: 2.1 time: 0.059121 Aug 06 22:22:21.777348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 616/1205] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:22:21 2022] GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:22:21.856374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3699099c-2bca-4c13-bcda-0e4eaedf8a03 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.680416 Aug 06 22:22:21.857268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 590/1206] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:22:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:22:21.868977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-db771f8e-0998-453d-bc64-5cb39933f7e6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:21.869878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-db771f8e-0998-453d-bc64-5cb39933f7e6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:21.932148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-db771f8e-0998-453d-bc64-5cb39933f7e6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:21.939601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-db771f8e-0998-453d-bc64-5cb39933f7e6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1238 microversion: 2.1 time: 0.074861 Aug 06 22:22:21.940173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 617/1207] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:21 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:22.195862 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:22.196560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:22.202541 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:22.203022 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:22.203453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:22.204142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:22.204626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:22.205049 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:22.337403 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:22.345643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-151fa99b-5248-4c5d-96df-f2e110998666 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1265 microversion: 2.1 time: 0.154057 Aug 06 22:22:22.346218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 591/1208] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:22 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:22.790934 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-53c17700-2f26-49e5-8e49-496d2fe9f53b tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6abd670>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:22.838092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-53c17700-2f26-49e5-8e49-496d2fe9f53b tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268" status: 200 len: 346 microversion: 2.1 time: 0.051414 Aug 06 22:22:22.838659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 618/1209] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:22:22 2022] GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:22.851579 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7b072d9b-c577-46bd-8672-6cf66f6eaf68 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Action: 'create', calling method: .version_select at 0x7f30c6959280>, body: {"snapshot": {"volume_id": "68116280-5c4e-4cb0-95f8-56bb0b03d268", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1437501260"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:22.961005 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1a59b8d4-678b-4738-a0c0-4f4d27b09a09 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:22.961679 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1a59b8d4-678b-4738-a0c0-4f4d27b09a09 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:23.014895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1a59b8d4-678b-4738-a0c0-4f4d27b09a09 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:23.022525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1a59b8d4-678b-4738-a0c0-4f4d27b09a09 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1238 microversion: 2.1 time: 0.065348 Aug 06 22:22:23.023087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 619/1210] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:22 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:22:23.367458 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:23.368082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:23.374410 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:23.374890 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:23.375323 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:23.377071 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:23.377537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:23.378116 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:23.486295 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7b072d9b-c577-46bd-8672-6cf66f6eaf68 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.637726 Aug 06 22:22:23.492727 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 592/1211] 10.222.0.18 () {60 vars in 1162 bytes} [Sat Aug 6 22:22:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:23.498187 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-19b07db4-78cd-453a-ba3c-f8c052f77372 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6df8b80>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:23.518732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:23.527755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a8c4566b-94fb-4f0e-adb8-a63cfb96f0ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1453 microversion: 2.1 time: 0.163111 Aug 06 22:22:23.527755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 620/1212] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:23 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:22:23.532869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-19b07db4-78cd-453a-ba3c-f8c052f77372 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 200 len: 287 microversion: 2.1 time: 0.037992 Aug 06 22:22:23.533436 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 593/1213] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:23 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:23.544319 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d0edb236-b093-40b2-8dc2-27e8a9e2f9d0 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c91c4af0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:23.546810 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:23.547488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:23.550619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:23.556975 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:23.557788 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:23.558340 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:23.559378 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:23.559954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:23.560386 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:23.592365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d0edb236-b093-40b2-8dc2-27e8a9e2f9d0 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.052121 Aug 06 22:22:23.592978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 621/1214] 10.222.0.18 () {58 vars in 1140 bytes} [Sat Aug 6 22:22:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:23.607269 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-12a27632-8101-48bd-b30e-d7ca7aea21c8 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6a80ee0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:23.648228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-12a27632-8101-48bd-b30e-d7ca7aea21c8 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 200 len: 287 microversion: 2.1 time: 0.045422 Aug 06 22:22:23.649094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 622/1215] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:23 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:23.710435 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:23.718041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-da63540f-610a-4c0f-8149-89fdd32f981c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1453 microversion: 2.1 time: 0.174884 Aug 06 22:22:23.718605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 594/1216] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:23 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:22:24.043414 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:24.044016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:24.051388 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:24.051867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:24.052296 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:24.053002 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:24.053452 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:24.053872 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:24.122111 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:24.130415 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-694af806-0703-43ae-9b53-2dcff3bc1817 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1234 microversion: 2.1 time: 0.091252 Aug 06 22:22:24.130915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 623/1217] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:24 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:24.661787 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c159c272-458c-4cb2-896f-6e2c3af9ca1b tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c68b74c0>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:24.693058 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c159c272-458c-4cb2-896f-6e2c3af9ca1b tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 200 len: 287 microversion: 2.1 time: 0.035111 Aug 06 22:22:24.693626 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 595/1218] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:24 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:25.152472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:25.153291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:25.159722 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:25.160208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:25.160676 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:25.161369 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:25.162488 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:25.162488 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:25.238556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:25.246032 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1bfe19ea-41e6-481c-85b2-6e83ffe152df tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1290 microversion: 2.1 time: 0.097437 Aug 06 22:22:25.246608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 624/1219] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:25 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:25.706129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f4d70923-dec1-4933-818d-2bbae66c2ca4 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30cb272f70>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:25.737959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f4d70923-dec1-4933-818d-2bbae66c2ca4 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 200 len: 287 microversion: 2.1 time: 0.036179 Aug 06 22:22:25.738524 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 596/1220] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:25 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:26.154237 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-45a3b4c8-6ce7-4cf2-8c09-797c2c21ad8f req-2ef2e29e-fe58-4c9c-992f-aa9b1d3eac57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6555e5ac-2ba8-4674-997b-e738b6ff64ed", "tag": "7a1af422-e9c2-4251-bfd8-5ab46189e6b8"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:26.165525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-45a3b4c8-6ce7-4cf2-8c09-797c2c21ad8f req-2ef2e29e-fe58-4c9c-992f-aa9b1d3eac57 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:26.166696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-45a3b4c8-6ce7-4cf2-8c09-797c2c21ad8f req-2ef2e29e-fe58-4c9c-992f-aa9b1d3eac57 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:26.166696 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-45a3b4c8-6ce7-4cf2-8c09-797c2c21ad8f req-2ef2e29e-fe58-4c9c-992f-aa9b1d3eac57 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:26.177616 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-45a3b4c8-6ce7-4cf2-8c09-797c2c21ad8f req-2ef2e29e-fe58-4c9c-992f-aa9b1d3eac57 service nova] Creating event network-changed:7a1af422-e9c2-4251-bfd8-5ab46189e6b8 for instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed on hv-cinder-84984 Aug 06 22:22:26.182648 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-45a3b4c8-6ce7-4cf2-8c09-797c2c21ad8f req-2ef2e29e-fe58-4c9c-992f-aa9b1d3eac57 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032115 Aug 06 22:22:26.183229 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 625/1221] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:26.269085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:26.270049 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:26.276756 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:26.277327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:26.277951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:26.278642 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:26.279097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:26.279519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:26.341698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:26.350255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c028728b-2d1b-406b-8b41-4c4f8df8db27 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1290 microversion: 2.1 time: 0.086034 Aug 06 22:22:26.360497 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 597/1222] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:26 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:26.751733 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b937b6e7-0dc9-49b3-b28f-0020e9c7214c tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6b23dc0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:26.782887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b937b6e7-0dc9-49b3-b28f-0020e9c7214c tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 200 len: 287 microversion: 2.1 time: 0.035918 Aug 06 22:22:26.783475 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 626/1223] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:26 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:27.370962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:27.371566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:27.378215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:27.378684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:27.379110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:27.379782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:27.380226 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:27.380670 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:27.445014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:27.452586 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5af76438-5653-45fa-9b2e-2ee916623b11 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1290 microversion: 2.1 time: 0.085373 Aug 06 22:22:27.453148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 598/1224] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:27 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:27.795896 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-47a91b2e-6f08-41d1-91a2-1bdbce11fdef tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6862550>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:27.829073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-47a91b2e-6f08-41d1-91a2-1bdbce11fdef tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 200 len: 287 microversion: 2.1 time: 0.037525 Aug 06 22:22:27.830170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 627/1225] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:27 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:28.474014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:28.474629 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:28.481199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:28.484521 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:28.484521 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:28.484521 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:28.484521 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:28.485649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:28.546159 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:28.553805 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2048b496-0238-40b2-ba60-7241156e450c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1296 microversion: 2.1 time: 0.084677 Aug 06 22:22:28.554375 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 599/1226] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:28 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:28.842247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-07adaf65-1f7d-48a2-94a9-2e1480dcaa5d tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6af1b80>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:28.872356 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-07adaf65-1f7d-48a2-94a9-2e1480dcaa5d tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 200 len: 288 microversion: 2.1 time: 0.034523 Aug 06 22:22:28.872956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 628/1227] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:28 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:28.885200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-238d0419-33ac-44da-9d59-8f8eab19b160 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30cb272820>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:29.033466 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-238d0419-33ac-44da-9d59-8f8eab19b160 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 202 len: 0 microversion: 2.1 time: 0.153026 Aug 06 22:22:29.034041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 600/1228] 10.222.0.18 () {58 vars in 1254 bytes} [Sat Aug 6 22:22:28 2022] DELETE /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:22:29.042453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d9f6511f-a592-4953-9894-efcf46459656 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6af11f0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:29.074153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d9f6511f-a592-4953-9894-efcf46459656 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 200 len: 287 microversion: 2.1 time: 0.035553 Aug 06 22:22:29.074716 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 629/1229] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:29 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:29.575354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:29.576073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:29.582105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:29.582589 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:29.583020 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:29.583717 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:29.584165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:29.584632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:29.716869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:29.719224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=100 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:29.726491 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-28355110-ece6-407b-9002-6322217587c5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1364 microversion: 2.1 time: 0.155428 Aug 06 22:22:29.732465 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 601/1230] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:29 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:29.846134 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-511c6cf1-5326-4c14-bb83-6b8ca7e49dee req-27b2eb50-80b3-4cb6-9094-dd6610d3999f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4110040-c454-4dac-b519-30ef2b9e7c68", "tag": "9383490b-8bb6-4fac-b09b-444e5daca958"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:29.859576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-511c6cf1-5326-4c14-bb83-6b8ca7e49dee req-27b2eb50-80b3-4cb6-9094-dd6610d3999f service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:29.860184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-511c6cf1-5326-4c14-bb83-6b8ca7e49dee req-27b2eb50-80b3-4cb6-9094-dd6610d3999f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:29.860742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-511c6cf1-5326-4c14-bb83-6b8ca7e49dee req-27b2eb50-80b3-4cb6-9094-dd6610d3999f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:29.871487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-511c6cf1-5326-4c14-bb83-6b8ca7e49dee req-27b2eb50-80b3-4cb6-9094-dd6610d3999f service nova] Creating event network-changed:9383490b-8bb6-4fac-b09b-444e5daca958 for instance e4110040-c454-4dac-b519-30ef2b9e7c68 on hv-cinder-84984 Aug 06 22:22:29.876350 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-511c6cf1-5326-4c14-bb83-6b8ca7e49dee req-27b2eb50-80b3-4cb6-9094-dd6610d3999f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035190 Aug 06 22:22:29.877663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 630/1231] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:22:30.087279 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bbe7cc9f-fcba-462c-8768-4b72a2c55009 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6970c10>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:30.113350 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-bbe7cc9f-fcba-462c-8768-4b72a2c55009 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] HTTP exception thrown: Snapshot c4e682d6-d765-4d52-a42b-52db5b7773d9 could not be found. Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bbe7cc9f-fcba-462c-8768-4b72a2c55009 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Request method failure captured: Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 HTTP/1.1 Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7umcIREyekmTStpWPJphaOMHjmhu4jumid76_zmaIQDGY5-pIkPODgt_gSk0m2GROCORO2yDAl9ChsKvw9xk3cxxEW_LykKXJOrcrLp5LWhEDakeW95fAziJvvm_45QGpV0anNIi_0DmD-8Yp3hnDrNGMJO7c_FU6NQoT2W6PIdqoR8 Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 23e22bb596ac4d93b8b004eecc50e91e Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:30.117199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_23e22bb596ac4d93b8b004eecc50e91e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 23e22bb596ac4d93b8b004eecc50e91e Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-VolumesSnapshotsTestJSON-2035296709-project Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: f69cc7c7585048fca2dc50a4bb4d80f8 Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2035296709-project Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Snapshot c4e682d6-d765-4d52-a42b-52db5b7773d9 could not be found. Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': 'c4e682d6-d765-4d52-a42b-52db5b7773d9'} Aug 06 22:22:30.118876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c4e682d6-d765-4d52-a42b-52db5b7773d9 could not be found. (HTTP 404) (Request-ID: req-36d1b444-87a1-411b-a93d-85dbf7cd4bb7) Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:30.119982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:22:30.121325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c4e682d6-d765-4d52-a42b-52db5b7773d9 could not be found. Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 06 22:22:30.122690 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c4e682d6-d765-4d52-a42b-52db5b7773d9 could not be found. Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c4e682d6-d765-4d52-a42b-52db5b7773d9 could not be found. Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bbe7cc9f-fcba-462c-8768-4b72a2c55009 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Returning 404 to user: Snapshot c4e682d6-d765-4d52-a42b-52db5b7773d9 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:30.124164 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bbe7cc9f-fcba-462c-8768-4b72a2c55009 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9" status: 404 len: 111 microversion: 2.1 time: 0.035819 Aug 06 22:22:30.125190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 602/1232] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Aug 6 22:22:30 2022] GET /compute/v2.1/os-snapshots/c4e682d6-d765-4d52-a42b-52db5b7773d9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:30.128288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4ffad496-2e6d-4fd8-8580-b6fb04af49ad tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6b27c10>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:30.437523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4ffad496-2e6d-4fd8-8580-b6fb04af49ad tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268" status: 202 len: 0 microversion: 2.1 time: 0.313438 Aug 06 22:22:30.438087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 631/1233] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:22:30 2022] DELETE /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:22:30.447220 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-44329301-3f0b-45be-9b2c-ae88e545909c tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30cb272310>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:30.496959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-44329301-3f0b-45be-9b2c-ae88e545909c tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268" status: 200 len: 345 microversion: 2.1 time: 0.053875 Aug 06 22:22:30.497563 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 603/1234] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:22:30 2022] GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:30.748049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:30.748859 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:30.755581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:30.756060 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:30.756526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:30.757217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:30.757671 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:30.758107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:30.889614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:30.897234 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0acc3d70-85ab-4492-897b-0ded709cddde tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1364 microversion: 2.1 time: 0.153045 Aug 06 22:22:30.897792 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 632/1235] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:30 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:31.511913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7e555ca3-0010-4812-82aa-62f0f8e82b08 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c69709d0>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:31.543000 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-7e555ca3-0010-4812-82aa-62f0f8e82b08 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] HTTP exception thrown: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7e555ca3-0010-4812-82aa-62f0f8e82b08 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Request method failure captured: Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 HTTP/1.1 Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7umcIREyekmTStpWPJphaOMHjmhu4jumid76_zmaIQDGY5-pIkPODgt_gSk0m2GROCORO2yDAl9ChsKvw9xk3cxxEW_LykKXJOrcrLp5LWhEDakeW95fAziJvvm_45QGpV0anNIi_0DmD-8Yp3hnDrNGMJO7c_FU6NQoT2W6PIdqoR8 Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 23e22bb596ac4d93b8b004eecc50e91e Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:31.544305 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_23e22bb596ac4d93b8b004eecc50e91e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 23e22bb596ac4d93b8b004eecc50e91e Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-VolumesSnapshotsTestJSON-2035296709-project Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: f69cc7c7585048fca2dc50a4bb4d80f8 Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2035296709-project Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '68116280-5c4e-4cb0-95f8-56bb0b03d268'} Aug 06 22:22:31.545970 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. (HTTP 404) (Request-ID: req-22f5c0cb-79df-4ab5-8257-98153d423244) Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.547117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:22:31.548550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 22:22:31.550206 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7e555ca3-0010-4812-82aa-62f0f8e82b08 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Returning 404 to user: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7e555ca3-0010-4812-82aa-62f0f8e82b08 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268" status: 404 len: 109 microversion: 2.1 time: 0.038306 Aug 06 22:22:31.551620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 604/1236] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:22:31 2022] GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:31.559628 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3c7142b7-9c50-4b53-8f0f-301b24948ba3 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30c6d5aca0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-3c7142b7-9c50-4b53-8f0f-301b24948ba3 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] HTTP exception thrown: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3c7142b7-9c50-4b53-8f0f-301b24948ba3 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Request method failure captured: Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: DELETE /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 HTTP/1.1 Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7umcIREyekmTStpWPJphaOMHjmhu4jumid76_zmaIQDGY5-pIkPODgt_gSk0m2GROCORO2yDAl9ChsKvw9xk3cxxEW_LykKXJOrcrLp5LWhEDakeW95fAziJvvm_45QGpV0anNIi_0DmD-8Yp3hnDrNGMJO7c_FU6NQoT2W6PIdqoR8 Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 23e22bb596ac4d93b8b004eecc50e91e Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:22:31.593222 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_23e22bb596ac4d93b8b004eecc50e91e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 23e22bb596ac4d93b8b004eecc50e91e Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-VolumesSnapshotsTestJSON-2035296709-project Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: f69cc7c7585048fca2dc50a4bb4d80f8 Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2035296709-project Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '68116280-5c4e-4cb0-95f8-56bb0b03d268'} Aug 06 22:22:31.594830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. (HTTP 404) (Request-ID: req-ce56bbce-59de-40d3-b168-e8d3cd8ae7da) Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.597207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 22:22:31.598654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 22:22:31.600090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3c7142b7-9c50-4b53-8f0f-301b24948ba3 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Returning 404 to user: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:31.601908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3c7142b7-9c50-4b53-8f0f-301b24948ba3 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268" status: 404 len: 109 microversion: 2.1 time: 0.035557 Aug 06 22:22:31.602898 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 633/1237] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:22:31 2022] DELETE /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:31.602989 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b6697cc1-5291-4a04-bb2e-93f6c52b0a78 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Calling method '.version_select at 0x7f30cb291550>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:31.629056 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-b6697cc1-5291-4a04-bb2e-93f6c52b0a78 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] HTTP exception thrown: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b6697cc1-5291-4a04-bb2e-93f6c52b0a78 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Request method failure captured: Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 HTTP/1.1 Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7umcIREyekmTStpWPJphaOMHjmhu4jumid76_zmaIQDGY5-pIkPODgt_gSk0m2GROCORO2yDAl9ChsKvw9xk3cxxEW_LykKXJOrcrLp5LWhEDakeW95fAziJvvm_45QGpV0anNIi_0DmD-8Yp3hnDrNGMJO7c_FU6NQoT2W6PIdqoR8 Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 23e22bb596ac4d93b8b004eecc50e91e Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:22:31.630991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_23e22bb596ac4d93b8b004eecc50e91e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/23e22bb596ac4d93b8b004eecc50e91e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 23e22bb596ac4d93b8b004eecc50e91e Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2035296709 Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-VolumesSnapshotsTestJSON-2035296709-project Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: f69cc7c7585048fca2dc50a4bb4d80f8 Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2035296709-project Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '68116280-5c4e-4cb0-95f8-56bb0b03d268'} Aug 06 22:22:31.632609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. (HTTP 404) (Request-ID: req-f341f008-763d-4628-9102-7609f7cddb08) Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.633649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 22:22:31.635060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 22:22:31.636484 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b6697cc1-5291-4a04-bb2e-93f6c52b0a78 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] Returning 404 to user: Volume 68116280-5c4e-4cb0-95f8-56bb0b03d268 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b6697cc1-5291-4a04-bb2e-93f6c52b0a78 tempest-VolumesSnapshotsTestJSON-2035296709 tempest-VolumesSnapshotsTestJSON-2035296709-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268" status: 404 len: 109 microversion: 2.1 time: 0.035748 Aug 06 22:22:31.637878 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 605/1238] 10.222.0.18 () {58 vars in 1245 bytes} [Sat Aug 6 22:22:31 2022] GET /compute/v2.1/os-volumes/68116280-5c4e-4cb0-95f8-56bb0b03d268 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:22:31.918549 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:31.919197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:31.926035 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:31.926548 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:31.927256 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:31.931900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:31.931900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:31.931900 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:32.062110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:32.077244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-14d0fc81-110e-4963-ba9e-7f7949239ff3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1364 microversion: 2.1 time: 0.156013 Aug 06 22:22:32.077244 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 634/1239] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:31 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:33.088161 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:33.088968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=6 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:33.093240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:33.093838 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:33.100634 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:33.101115 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:33.101540 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:33.102215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:33.102658 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:33.103071 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:33.237381 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:33.245046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fbb2812d-d101-48e8-af4d-455f844fbfdc tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1364 microversion: 2.1 time: 0.157624 Aug 06 22:22:33.245673 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 606/1240] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:33 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:34.266540 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:34.267718 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:34.270245 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=8 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:22:34.275198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:34.281842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:34.281842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:34.281842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:34.281842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:34.282226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:34.417177 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:34.426483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d7b078f2-4614-400a-8389-22f856b4742f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1364 microversion: 2.1 time: 0.163872 Aug 06 22:22:34.427107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 635/1241] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:34 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:35.447203 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:35.448145 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:35.462686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:35.463181 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:35.463618 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:35.464386 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:35.465153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:35.465284 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:35.527824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-e73b6e07-588b-4843-b495-921e44bc3b2e req-798deb2a-b278-4163-b7c3-9ead532961d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4110040-c454-4dac-b519-30ef2b9e7c68", "name": "network-vif-plugged", "status": "completed", "tag": "9383490b-8bb6-4fac-b09b-444e5daca958"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:35.540889 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e73b6e07-588b-4843-b495-921e44bc3b2e req-798deb2a-b278-4163-b7c3-9ead532961d2 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:35.541453 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e73b6e07-588b-4843-b495-921e44bc3b2e req-798deb2a-b278-4163-b7c3-9ead532961d2 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:35.541954 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-e73b6e07-588b-4843-b495-921e44bc3b2e req-798deb2a-b278-4163-b7c3-9ead532961d2 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:35.553354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-e73b6e07-588b-4843-b495-921e44bc3b2e req-798deb2a-b278-4163-b7c3-9ead532961d2 service nova] Creating event network-vif-plugged:9383490b-8bb6-4fac-b09b-444e5daca958 for instance e4110040-c454-4dac-b519-30ef2b9e7c68 on hv-cinder-84984 Aug 06 22:22:35.558473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-e73b6e07-588b-4843-b495-921e44bc3b2e req-798deb2a-b278-4163-b7c3-9ead532961d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035667 Aug 06 22:22:35.559071 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 636/1242] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:22:35.625516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:35.634314 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-91ac931c-2db0-4a10-ad59-d87377b23b96 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1364 microversion: 2.1 time: 0.191025 Aug 06 22:22:35.634941 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 607/1243] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:35 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:36.655959 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:36.656841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:36.663608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:36.664124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:36.664595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:36.665301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:36.665758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:36.666186 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:36.802804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:36.810173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-86157d83-da9d-48d4-a6d3-7744e57475c7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1364 microversion: 2.1 time: 0.158866 Aug 06 22:22:36.810729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 637/1244] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:36 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:37.831792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:37.832338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:37.838781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:37.839261 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:37.839697 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:37.840387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:37.840863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:37.841287 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:37.980671 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:37.989649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-98fd1b77-3f22-4b54-b662-af961a700e86 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1364 microversion: 2.1 time: 0.162146 Aug 06 22:22:37.996729 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 608/1245] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:37 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:39.010496 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:39.011185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:39.018395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:39.018880 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:39.019317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:39.020011 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:39.020525 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:39.020956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:39.148731 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:22:39.156151 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9244bf22-6c7a-445d-a84e-40aa5a70f49a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1550 microversion: 2.1 time: 0.149591 Aug 06 22:22:39.156734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 638/1246] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:22:39 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:22:39.176897 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:22:39.177441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:22:39.183931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:39.184446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:39.184884 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:39.185562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:39.186035 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:39.186455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:39.263907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e1240a2c-bb78-40ff-b75d-2d4ff9f073ac tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090760 Aug 06 22:22:39.264514 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 609/1247] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Aug 6 22:22:39 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:22:40.464877 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-79f74769-42a3-438b-bdcd-606fa84e9ecc req-e19b07bc-dab0-4055-97dc-694be82f73b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4110040-c454-4dac-b519-30ef2b9e7c68", "tag": "9383490b-8bb6-4fac-b09b-444e5daca958"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:22:40.475559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-79f74769-42a3-438b-bdcd-606fa84e9ecc req-e19b07bc-dab0-4055-97dc-694be82f73b8 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:22:40.476064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-79f74769-42a3-438b-bdcd-606fa84e9ecc req-e19b07bc-dab0-4055-97dc-694be82f73b8 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:22:40.476527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-79f74769-42a3-438b-bdcd-606fa84e9ecc req-e19b07bc-dab0-4055-97dc-694be82f73b8 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:22:40.490194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-79f74769-42a3-438b-bdcd-606fa84e9ecc req-e19b07bc-dab0-4055-97dc-694be82f73b8 service nova] Creating event network-changed:9383490b-8bb6-4fac-b09b-444e5daca958 for instance e4110040-c454-4dac-b519-30ef2b9e7c68 on hv-cinder-84984 Aug 06 22:22:40.495141 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-79f74769-42a3-438b-bdcd-606fa84e9ecc req-e19b07bc-dab0-4055-97dc-694be82f73b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033973 Aug 06 22:22:40.495727 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 639/1248] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:23:58.480652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=17 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:23:58.481394 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=23 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:23:58.485720 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:23:58.486234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:23:58.492125 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:23:58.492641 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:23:58.493201 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:23:58.493738 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:23:58.494186 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:23:58.494605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:23:58.518998 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d392fa60-cf41-4f21-8efe-8c92ace8c94b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/ips" status: 200 len: 146 microversion: 2.1 time: 0.040262 Aug 06 22:23:58.521652 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 610/1249] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:23:58 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:23:59.600933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=33 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:23:59.602648 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=70 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:23:59.606173 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-966018359", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:23:59.657638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] validate_networks() for None {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:23:59.938814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:23:59.939218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:23:59.939685 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:23:59.940090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:23:59.941079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:23:59.949978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:23:59.950447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:23:59.950873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:23:59.951587 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:23:59.952032 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:23:59.952529 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:23:59.970376 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Getting quotas for project 676d7214383f4677989de5282569bd67. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:23:59.974705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Getting quotas for user 15d2106935444c97b1e8c50131d3171f and project 676d7214383f4677989de5282569bd67. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:23:59.985700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:23:59.993470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:24:00.111301 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9f680ac9-4358-44aa-8e4e-b263b7a3aa0d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512758 Aug 06 22:24:00.112187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 640/1250] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:24:00.123854 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-426d20af-ae11-47e8-8895-92938027f84d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:00.124721 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-426d20af-ae11-47e8-8895-92938027f84d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:00.179098 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-426d20af-ae11-47e8-8895-92938027f84d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:00.186364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-426d20af-ae11-47e8-8895-92938027f84d tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1214 microversion: 2.1 time: 0.066835 Aug 06 22:24:00.187658 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 611/1251] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:00 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:01.113573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3db52911-6b12-417d-8125-247499996d2d"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:24:01.116087 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:01.122379 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:01.122854 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:01.123286 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:01.124069 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:01.124560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:01.124973 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:01.209238 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4b481889-6316-4a0e-9d06-918b5051cfc6 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:01.209872 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4b481889-6316-4a0e-9d06-918b5051cfc6 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:01.266426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-4b481889-6316-4a0e-9d06-918b5051cfc6 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:01.274132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4b481889-6316-4a0e-9d06-918b5051cfc6 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1214 microversion: 2.1 time: 0.069585 Aug 06 22:24:01.274685 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 612/1252] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:01 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:24:01.848473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f61ea339-a804-49a5-86c2-61788f00c64f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740388 Aug 06 22:24:01.849130 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 641/1253] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:24:01 2022] POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:24:02.295016 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:02.295664 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:02.302302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:02.302783 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:02.303216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:02.303951 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:02.304394 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:02.304850 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:02.366549 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:02.374132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7aa92c9a-cebf-4b33-8a27-ca405b401fb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1266 microversion: 2.1 time: 0.083021 Aug 06 22:24:02.374699 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 613/1254] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:02 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:03.398413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:03.399123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:03.405464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:03.405950 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:03.406390 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:03.407096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:03.407559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:03.407992 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:03.476271 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:03.483944 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d4c4f2c8-d97f-4d95-b84b-0f57960d9bc0 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1272 microversion: 2.1 time: 0.091102 Aug 06 22:24:03.484556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 642/1255] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:03 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:04.504737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:04.505359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:04.511672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:04.512152 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:04.512621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:04.513315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:04.513769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:04.514199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:04.644041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:04.651683 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-9143e088-c219-48db-bbcc-d6fb2263b815 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1314 microversion: 2.1 time: 0.151050 Aug 06 22:24:04.655794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 614/1256] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:04 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:04.933893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-6330c90a-2c06-49b5-851f-79746aa5b7c6 req-3df64802-493c-4b0e-84d1-351b8f493259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ef2189-9915-451a-93a8-f30bffc95846", "tag": "2273d470-e906-4970-ae2b-6a0a21a19ba1"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:24:04.943734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-6330c90a-2c06-49b5-851f-79746aa5b7c6 req-3df64802-493c-4b0e-84d1-351b8f493259 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:04.944226 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-6330c90a-2c06-49b5-851f-79746aa5b7c6 req-3df64802-493c-4b0e-84d1-351b8f493259 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:04.944684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-6330c90a-2c06-49b5-851f-79746aa5b7c6 req-3df64802-493c-4b0e-84d1-351b8f493259 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:04.955714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-6330c90a-2c06-49b5-851f-79746aa5b7c6 req-3df64802-493c-4b0e-84d1-351b8f493259 service nova] Creating event network-changed:2273d470-e906-4970-ae2b-6a0a21a19ba1 for instance 04ef2189-9915-451a-93a8-f30bffc95846 on hv-cinder-84984 Aug 06 22:24:04.962622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-6330c90a-2c06-49b5-851f-79746aa5b7c6 req-3df64802-493c-4b0e-84d1-351b8f493259 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034219 Aug 06 22:24:04.962622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 643/1257] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:24:05.673325 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:05.673938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:05.680865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:05.681357 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:05.681781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:05.682464 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:05.682917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:05.683339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:05.811153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:05.818552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fbc38cd0-afcd-42b1-9d67-1900f011422e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1314 microversion: 2.1 time: 0.149059 Aug 06 22:24:05.819111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 615/1258] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:05 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:06.839576 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:06.840276 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:06.847317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:06.847802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:06.848240 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:06.848963 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:06.849422 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:06.849848 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:06.981163 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:06.989473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3810dbf6-9dcc-4b17-80e7-25ef34dc66f7 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1314 microversion: 2.1 time: 0.154097 Aug 06 22:24:06.990036 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 644/1259] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:06 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:08.010216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:08.010811 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:08.017245 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:08.017724 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:08.018188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:08.018891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:08.019346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:08.019811 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:08.148307 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:08.155804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1e287041-8708-417b-a9fe-1e57941aadb4 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1314 microversion: 2.1 time: 0.149479 Aug 06 22:24:08.156367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 616/1260] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:08 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:09.175531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:09.176258 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:09.182695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:09.183170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:09.183604 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:09.184309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:09.184784 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:09.185204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:09.316322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:09.323787 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-7a4ea483-fe12-4ba1-a94c-914552e374dc tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1314 microversion: 2.1 time: 0.152309 Aug 06 22:24:09.324343 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 645/1261] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:09 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:10.028203 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-64ad6d65-3b53-40ca-8424-b8563162b419 req-716604c3-e61a-46b9-a023-7c250fcad080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ef2189-9915-451a-93a8-f30bffc95846", "name": "network-vif-plugged", "status": "completed", "tag": "2273d470-e906-4970-ae2b-6a0a21a19ba1"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:24:10.038301 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-64ad6d65-3b53-40ca-8424-b8563162b419 req-716604c3-e61a-46b9-a023-7c250fcad080 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:10.046109 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-64ad6d65-3b53-40ca-8424-b8563162b419 req-716604c3-e61a-46b9-a023-7c250fcad080 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:10.046109 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-64ad6d65-3b53-40ca-8424-b8563162b419 req-716604c3-e61a-46b9-a023-7c250fcad080 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:10.049693 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-64ad6d65-3b53-40ca-8424-b8563162b419 req-716604c3-e61a-46b9-a023-7c250fcad080 service nova] Creating event network-vif-plugged:2273d470-e906-4970-ae2b-6a0a21a19ba1 for instance 04ef2189-9915-451a-93a8-f30bffc95846 on hv-cinder-84984 Aug 06 22:24:10.055236 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-64ad6d65-3b53-40ca-8424-b8563162b419 req-716604c3-e61a-46b9-a023-7c250fcad080 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030676 Aug 06 22:24:10.055802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 617/1262] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:24:10.353334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:10.354414 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:10.355935 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:10.356685 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=6 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:10.365180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:10.369133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:10.369133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:10.369133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:10.369133 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:10.369727 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:10.444772 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b0887d67-2c0b-4b64-ae17-8ebfc9f03349 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:24:10.451548 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0887d67-2c0b-4b64-ae17-8ebfc9f03349 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:10.452029 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0887d67-2c0b-4b64-ae17-8ebfc9f03349 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:10.452868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0887d67-2c0b-4b64-ae17-8ebfc9f03349 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:10.508826 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:10.516248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-565b2f83-d879-4213-ad7a-d9b8c16ec41e tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1314 microversion: 2.1 time: 0.166706 Aug 06 22:24:10.516834 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 646/1263] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:10 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:10.517456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b0887d67-2c0b-4b64-ae17-8ebfc9f03349 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Going to try to stop instance {{(pid=118456) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 22:24:10.690103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b0887d67-2c0b-4b64-ae17-8ebfc9f03349 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/action" status: 202 len: 0 microversion: 2.1 time: 0.249535 Aug 06 22:24:10.690594 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 618/1264] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:24:10 2022] POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 22:24:10.699265 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:10.699875 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:10.705823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:10.706307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:10.706772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:10.707422 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:10.707870 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:10.708291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:10.837239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:10.845518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-412e7327-3e80-4bf8-936c-8eac8af26c47 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.150059 Aug 06 22:24:10.846083 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 647/1265] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:10 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:11.535178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:11.539303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:11.540026 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:11.546066 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:11.546480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:11.546908 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:11.547581 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:11.548026 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:11.548471 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:11.678355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:11.685773 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-31848bc8-82f8-43c8-ab89-8f3dc5ba6a0f tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1314 microversion: 2.1 time: 0.152100 Aug 06 22:24:11.686329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 619/1266] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:11 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:11.867981 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:11.868571 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:11.875218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:11.875851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:11.876317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:11.877040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:11.877495 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:11.877940 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:12.007112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:12.015025 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-84abbbd6-0cda-4594-b07c-22780a8c70d0 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.150973 Aug 06 22:24:12.015583 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 648/1267] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:11 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:12.709687 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:12.710296 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:12.716539 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:12.717015 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:12.717441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:12.718121 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:12.718565 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:12.718985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:12.848789 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:12.856333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ef716df1-61d1-4786-b3a7-4632bd820698 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1463 microversion: 2.1 time: 0.151535 Aug 06 22:24:12.856918 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 620/1268] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:12 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:12.906613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:12.907273 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:12.913940 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:12.914412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:12.914841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:12.915737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:12.916184 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:12.916735 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:12.943170 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:24:13.038034 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:13.038561 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:13.044756 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:13.049503 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:13.049503 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:13.049503 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:13.049503 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:13.049885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:13.178950 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:13.186938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-195fca6a-c2d9-4caa-9572-2852c0e82bef tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.154083 Aug 06 22:24:13.187502 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 621/1269] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:13 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:24:13.217756 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1d693e89-eb63-4d1f-a42f-03aaeae4b5bb tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "DELETE /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 204 len: 0 microversion: 2.1 time: 0.314798 Aug 06 22:24:13.218418 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 649/1270] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:24:12 2022] DELETE /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:24:13.227218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:13.227814 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:13.233734 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:13.234211 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:13.234658 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:13.235312 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:13.235754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:13.236169 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:13.368598 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:13.376060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-feb30026-d241-41a8-98d0-ac4729fb3b02 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1469 microversion: 2.1 time: 0.152590 Aug 06 22:24:13.376657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 622/1271] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:13 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:24:14.210150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:14.210842 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:14.217308 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:14.217789 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:14.218224 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:14.218905 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:14.219352 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:14.219772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:14.347239 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:14.355297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a0217ebf-8fad-4a61-be25-00bdcbb6ea06 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.150036 Aug 06 22:24:14.355860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 650/1272] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:14 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:14.397138 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:14.397749 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:14.404081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:14.404600 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:14.405026 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:14.405698 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:14.406145 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:14.406560 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:14.532524 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:14.539900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bd2b38b9-1063-4694-88e7-7a6f0873b7d9 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1469 microversion: 2.1 time: 0.146790 Aug 06 22:24:14.540467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 623/1273] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:14 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:15.378511 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:15.379072 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:15.387732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:15.388447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:15.388947 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:15.389678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:15.390123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:15.390976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:15.403829 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-2bd6c2ca-80dd-4aa4-bf0f-660a03382bf2 req-8ab75942-2c43-4621-9d5d-dcd1bde7518b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ef2189-9915-451a-93a8-f30bffc95846", "name": "network-vif-deleted", "tag": "2273d470-e906-4970-ae2b-6a0a21a19ba1"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:24:15.415705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2bd6c2ca-80dd-4aa4-bf0f-660a03382bf2 req-8ab75942-2c43-4621-9d5d-dcd1bde7518b service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:15.416256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2bd6c2ca-80dd-4aa4-bf0f-660a03382bf2 req-8ab75942-2c43-4621-9d5d-dcd1bde7518b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:15.416794 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-2bd6c2ca-80dd-4aa4-bf0f-660a03382bf2 req-8ab75942-2c43-4621-9d5d-dcd1bde7518b service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:15.432088 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-2bd6c2ca-80dd-4aa4-bf0f-660a03382bf2 req-8ab75942-2c43-4621-9d5d-dcd1bde7518b service nova] Creating event network-vif-deleted:2273d470-e906-4970-ae2b-6a0a21a19ba1 for instance 04ef2189-9915-451a-93a8-f30bffc95846 on hv-cinder-84984 Aug 06 22:24:15.437402 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-2bd6c2ca-80dd-4aa4-bf0f-660a03382bf2 req-8ab75942-2c43-4621-9d5d-dcd1bde7518b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037408 Aug 06 22:24:15.437997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 624/1274] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:24:15.547155 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:15.555978 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3ff84039-6fe8-4779-af01-c78b891f1b83 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.183538 Aug 06 22:24:15.556485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 651/1275] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:15 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:15.562942 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:15.563636 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:15.572462 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:15.573018 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:15.573468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:15.574173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:15.574621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:15.575044 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:15.637867 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d2106935444c97b1e8c50131d3171f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676d7214383f4677989de5282569bd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:15.645390 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-49e1992b-dced-49cc-bc0c-c64eabaad542 tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 200 len: 1299 microversion: 2.1 time: 0.088320 Aug 06 22:24:15.645953 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 625/1276] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:15 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:24:16.577291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:16.577892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:16.584394 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:16.584894 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:16.585317 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:16.586022 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:16.586465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:16.586876 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:16.666556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:16.667177 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] [instance: 04ef2189-9915-451a-93a8-f30bffc95846] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:16.673762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:16.674246 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:16.674682 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:16.676528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:16.676994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:16.677441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:16.692226 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] HTTP exception thrown: Instance 04ef2189-9915-451a-93a8-f30bffc95846 could not be found. Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Request method failure captured: Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 HTTP/1.1 Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7un9lm6BHh6b5cH8i9hNpwEf2hpfiK32Z6cTDYk89XpJ3K03VKzK0bLX_UeDruuXI6-KfM97_JH17flKMDZen4vTNVUbrg3mBVBzmJOTqbz3pL11-9Z6V-SZd_TCWSQu9CapJN_c2TvaI4mk1ISdS-cmPeCa_9qnJQsENrITp5j-S1E Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 676d7214383f4677989de5282569bd67 Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-VolumesNegativeTest-254479952 Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:24:16.693926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676d7214383f4677989de5282569bd67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676d7214383f4677989de5282569bd67", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676d7214383f4677989de5282569bd67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676d7214383f4677989de5282569bd67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-VolumesNegativeTest-254479952 Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 676d7214383f4677989de5282569bd67 Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-VolumesNegativeTest-254479952 Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-VolumesNegativeTest-254479952-project Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 15d2106935444c97b1e8c50131d3171f Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-VolumesNegativeTest-254479952-project Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 04ef2189-9915-451a-93a8-f30bffc95846 could not be found. Aug 06 22:24:16.695628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '04ef2189-9915-451a-93a8-f30bffc95846'} Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ef2189-9915-451a-93a8-f30bffc95846 could not be found. Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:24:16.696672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ef2189-9915-451a-93a8-f30bffc95846 could not be found. Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ef2189-9915-451a-93a8-f30bffc95846 could not be found. Aug 06 22:24:16.697993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:16.699169 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] Returning 404 to user: Instance 04ef2189-9915-451a-93a8-f30bffc95846 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:24:16.699169 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b6136488-f31c-488a-8348-5c63137bddbe tempest-VolumesNegativeTest-254479952 tempest-VolumesNegativeTest-254479952-project] 10.222.0.18 "GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846" status: 404 len: 111 microversion: 2.1 time: 0.032678 Aug 06 22:24:16.699169 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 626/1277] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:16 2022] GET /compute/v2.1/servers/04ef2189-9915-451a-93a8-f30bffc95846 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 22:24:16.719596 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:16.729007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-574158c3-79b5-4ad9-9798-ab64851b2e5f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.155661 Aug 06 22:24:16.729569 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 652/1278] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:16 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:17.751090 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:17.751762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:17.759031 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:17.766269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:17.766269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:17.766269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:17.766269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:17.766708 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:17.905266 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:17.915868 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ec36e3d1-425f-42c3-9716-f3173cf440e3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.168630 Aug 06 22:24:17.916635 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 627/1279] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:17 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:18.937813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:18.938383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:18.945023 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:18.945511 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:18.945949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:18.946678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:18.947137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:18.947564 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:19.077877 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:19.086399 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3713c2bb-64e3-4341-a0fe-824259615284 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.152584 Aug 06 22:24:19.086963 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 653/1280] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:18 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:20.110504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:20.111108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:20.118280 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:20.118887 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:20.119318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:20.120004 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:20.120468 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:20.120888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:20.254960 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:20.263200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-acbfd9ce-60ba-4209-aad6-41b2c10ac313 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.156503 Aug 06 22:24:20.263755 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 628/1281] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:20 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:21.285840 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:21.286463 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:21.293057 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:21.293543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:21.293979 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:21.294681 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:21.295176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:21.295605 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:21.422123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:21.425693 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:21.430494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2249ab79-d797-4f03-8765-ac89a76461db tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.149251 Aug 06 22:24:21.431056 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 654/1282] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:21 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:22.452455 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:22.453096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:22.459684 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:22.460163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:22.460633 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:22.461317 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:22.461766 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:22.462187 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:22.595258 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:22.602943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:22.605663 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fd58d322-ab08-42a0-9aeb-bf657c50def4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.157077 Aug 06 22:24:22.606224 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 629/1283] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:22 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:23.626351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:23.626955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:23.634903 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:23.635380 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:23.635808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:23.636518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:23.637357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:23.637357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:23.763698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:23.771537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f6502477-e995-493d-9492-1bb75c345b34 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.149002 Aug 06 22:24:23.772092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 655/1284] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:23 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:24.792954 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:24.793559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:24.802293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:24.802767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:24.803198 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:24.803881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:24.804327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:24.804775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:24.931489 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:24.939303 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a5130277-193a-49e3-8822-c303ec56418a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.150580 Aug 06 22:24:24.939860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 630/1285] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:24 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:25.961392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:25.961988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:25.968421 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:25.968906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:25.969338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:25.970021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:25.970472 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:25.970893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:26.101642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:26.109583 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0e64d078-66df-4ad8-9b61-b52bf79d1deb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.153095 Aug 06 22:24:26.110143 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 656/1286] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:25 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:27.130946 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:27.131585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:27.138002 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:27.138481 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:27.138918 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:27.139631 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:27.140088 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:27.140545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:27.271991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:27.280010 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f84fd5fa-9249-4a0e-b1c5-a52489c890ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.153204 Aug 06 22:24:27.280610 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 631/1287] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:27 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:28.302263 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:28.302920 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:28.309246 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:28.309725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:28.310155 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:28.310839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:28.311288 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:28.311707 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:28.447762 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:28.455873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4b381d36-700f-4666-bdc6-b6f4a13382f9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.158224 Aug 06 22:24:28.456445 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 657/1288] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:28 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:29.477660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:29.478251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:29.484647 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:29.485116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:29.485544 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:29.486216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:29.486753 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:29.487175 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:29.612775 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:29.621131 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bc19d3e8-7cab-41cc-bdda-fdb516628b31 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.147352 Aug 06 22:24:29.621686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 632/1289] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:29 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:30.643284 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:30.643839 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:30.646884 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:30.651606 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:30.652076 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:30.652531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:30.653211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:30.653654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:30.654071 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:30.781291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:30.789464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6ca19c45-e3e2-4282-b522-fa289d940880 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.150178 Aug 06 22:24:30.790027 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 658/1290] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:30 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:31.811931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:31.812504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:31.814865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=51 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:31.819621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:31.820097 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:31.820553 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:31.821240 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:31.821705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:31.822154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:31.956138 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:31.965632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ab989806-ab6c-422a-94c3-b7f1858fb9b6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1725 microversion: 2.1 time: 0.158269 Aug 06 22:24:31.966225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 633/1291] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:31 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:32.987147 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:32.987740 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:32.994977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:32.995485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:32.995923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:32.996650 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:32.997102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:32.997522 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:33.126026 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:33.134156 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-956e32f8-4db8-40dd-abc6-986c1d56ab5a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1702 microversion: 2.1 time: 0.150892 Aug 06 22:24:33.134758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 659/1292] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:32 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1702 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:33.154869 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e3fd8969-3423-4852-ae47-4cc63ac98038 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:24:33.161790 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3fd8969-3423-4852-ae47-4cc63ac98038 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:33.162272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3fd8969-3423-4852-ae47-4cc63ac98038 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:33.162706 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e3fd8969-3423-4852-ae47-4cc63ac98038 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:33.184857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e3fd8969-3423-4852-ae47-4cc63ac98038 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Going to try to start instance {{(pid=118456) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 22:24:33.337935 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e3fd8969-3423-4852-ae47-4cc63ac98038 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/action" status: 202 len: 0 microversion: 2.1 time: 0.186600 Aug 06 22:24:33.338465 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 634/1293] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:24:33 2022] POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:24:33.347106 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:33.348580 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:33.355065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:33.355547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:33.355975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:33.356714 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:33.357160 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:33.357581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:33.489588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:33.498011 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-fff7729b-f58b-483e-89f4-dde51e068733 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1711 microversion: 2.1 time: 0.155280 Aug 06 22:24:33.498570 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 660/1294] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:33 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:34.520959 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:34.521662 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:34.527872 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:34.528380 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:34.528847 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:34.529534 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:34.529981 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:34.531105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:34.659437 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:34.668075 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b8b2c2d8-84ae-4bc7-a447-51ad340d404f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1711 microversion: 2.1 time: 0.152447 Aug 06 22:24:34.668668 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 635/1295] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:34 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:35.689354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:35.689909 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:35.696512 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:35.696994 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:35.697428 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:35.698112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:35.698560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:35.698984 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:35.827800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:35.835790 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-62bf5891-dda7-46c9-b78a-bb931ba8f57a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1715 microversion: 2.1 time: 0.150380 Aug 06 22:24:35.836354 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 661/1296] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:35 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:49.627865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:49.628353 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:49.630554 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=5 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:49.631209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:49.635927 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:49.636426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:49.636866 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:49.637550 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:49.637998 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:49.638419 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:49.664052 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:24:49.930906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c1ce1322-eb50-4da1-b801-60ecb2b34a81 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 204 len: 0 microversion: 2.1 time: 0.306761 Aug 06 22:24:49.931545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 636/1297] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:24:49 2022] DELETE /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:24:49.939860 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:49.940545 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:49.943409 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=7 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:49.944084 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=42 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:24:49.948806 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:49.949290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:49.949726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:49.950419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:49.950868 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:49.951290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:50.081243 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:50.090290 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-96bedfc5-3242-4721-99eb-35aada264cf0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1578 microversion: 2.1 time: 0.154412 Aug 06 22:24:50.090857 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 662/1298] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:49 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:51.111659 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:51.112350 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:51.118753 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:51.119228 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:51.119655 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:51.120327 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:51.120803 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:51.121213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:51.253091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:51.260513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-814e516d-de11-40d5-bc56-f51d4ce14467 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1578 microversion: 2.1 time: 0.153093 Aug 06 22:24:51.261094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 637/1299] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:51 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:52.281918 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:52.285612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:52.289198 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:52.289678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:52.290114 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:52.290801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:52.291257 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:52.291682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:52.427672 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:52.435164 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-300659cd-0641-4d4d-8a56-acf5bc9743a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1578 microversion: 2.1 time: 0.157031 Aug 06 22:24:52.439419 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 663/1300] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:52 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:52.771993 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-6bd16069-780c-451b-95a4-e7e11877834c req-9372f32d-de57-4394-8ac7-ddaf95e1f1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6555e5ac-2ba8-4674-997b-e738b6ff64ed", "name": "network-vif-deleted", "tag": "7a1af422-e9c2-4251-bfd8-5ab46189e6b8"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:24:52.782142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6bd16069-780c-451b-95a4-e7e11877834c req-9372f32d-de57-4394-8ac7-ddaf95e1f1ca service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:52.787996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6bd16069-780c-451b-95a4-e7e11877834c req-9372f32d-de57-4394-8ac7-ddaf95e1f1ca service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:52.787996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6bd16069-780c-451b-95a4-e7e11877834c req-9372f32d-de57-4394-8ac7-ddaf95e1f1ca service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:52.795786 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-6bd16069-780c-451b-95a4-e7e11877834c req-9372f32d-de57-4394-8ac7-ddaf95e1f1ca service nova] Creating event network-vif-deleted:7a1af422-e9c2-4251-bfd8-5ab46189e6b8 for instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed on hv-cinder-84984 Aug 06 22:24:52.801470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-6bd16069-780c-451b-95a4-e7e11877834c req-9372f32d-de57-4394-8ac7-ddaf95e1f1ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033185 Aug 06 22:24:52.801972 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 638/1301] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:24:53.455737 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:53.456423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:53.463158 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:53.463885 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:53.464348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:53.465077 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:53.465527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:53.465949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:53.499707 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:53.500205 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:53.500663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:53.501110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lazy-loading 'fault' on Instance uuid 6555e5ac-2ba8-4674-997b-e738b6ff64ed {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:24:53.543998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:53.552489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-14c3fd1c-ba0b-427f-b7b8-840447a77e20 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 200 len: 1230 microversion: 2.1 time: 0.100617 Aug 06 22:24:53.553094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 664/1302] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:53 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:54.574598 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:54.575317 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:54.581422 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:54.582694 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:54.583128 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:54.583807 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:54.584254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:54.584729 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:54.597848 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] HTTP exception thrown: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Request method failure captured: Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed HTTP/1.1 Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7uloKkHXbtRLKHNvoJdjwBgj2Ai-AZAwUKOBf92dXMaB4dovzNB3Q7sW1II9uXtw69WMvtOD0kOtvKs5nf9UMFf4gjiSsRHW8itN2_GXFnKWWJVmLGLtduuBhJKakifOBf9sGFI3PsjRTPwUyIDqd9KT7GXFCJVfbwDEhEupg8IAJaw Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:24:54.599439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8168ba3e30a743a582d1c182ca2423b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-TestVolumeBootPattern-538900757 Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 2dae6a7ec4404626b75a6702386d091b Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:24:54.601210 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '6555e5ac-2ba8-4674-997b-e738b6ff64ed'} Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:24:54.602264 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:24:54.604032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:24:54.605531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Returning 404 to user: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:24:54.605531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3bbd20d3-257e-4ba1-9350-62c346eaddff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 404 len: 111 microversion: 2.1 time: 0.030847 Aug 06 22:24:54.605531 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 639/1303] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:54 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:24:54.697267 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1886082555", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898913352", "security_groups": [{"name": "tempest-secgroup-smoke-304693870"}], "block_device_mapping_v2": [{"uuid": "ae87ee63-66f4-4348-8c00-513c605dea3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "356b570d-9374-438e-9b29-c0fd0612d386"}]}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:24:54.807726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] validate_networks() for [('356b570d-9374-438e-9b29-c0fd0612d386', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:24:55.259595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:24:55.260027 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:24:55.260540 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:24:55.260956 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:24:55.261372 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:24:55.270137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:55.270615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:55.271049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:55.271777 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:24:55.272230 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:24:55.272685 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:24:55.289686 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Getting quotas for project 8168ba3e30a743a582d1c182ca2423b3. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:24:55.293629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Getting quotas for user 2dae6a7ec4404626b75a6702386d091b and project 8168ba3e30a743a582d1c182ca2423b3. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:24:55.351878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:24:55.352739 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae87ee63-66f4-4348-8c00-513c605dea3d',volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:24:55.760518 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-71eec2f6-e6f1-4cf1-a10d-b8f9c0b1e718 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.066979 Aug 06 22:24:55.762080 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 665/1304] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:24:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:24:55.772535 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ddc24393-baa2-4dcd-86cd-abd743614e26 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:55.773158 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ddc24393-baa2-4dcd-86cd-abd743614e26 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:55.829352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-ddc24393-baa2-4dcd-86cd-abd743614e26 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:55.836549 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ddc24393-baa2-4dcd-86cd-abd743614e26 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1094 microversion: 2.1 time: 0.068513 Aug 06 22:24:55.837104 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 640/1305] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:55 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:56.858178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-048071c2-059e-4e71-b17f-16bfc6d907a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:56.858867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-048071c2-059e-4e71-b17f-16bfc6d907a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:56.911750 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-048071c2-059e-4e71-b17f-16bfc6d907a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:56.918340 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-048071c2-059e-4e71-b17f-16bfc6d907a9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1094 microversion: 2.1 time: 0.064178 Aug 06 22:24:56.918988 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 666/1306] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:56 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:57.938740 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-d1e05277-7462-410a-9dbe-d8d4d5191144 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:57.939346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-d1e05277-7462-410a-9dbe-d8d4d5191144 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:57.993916 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-d1e05277-7462-410a-9dbe-d8d4d5191144 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:58.001123 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-d1e05277-7462-410a-9dbe-d8d4d5191144 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1094 microversion: 2.1 time: 0.066064 Aug 06 22:24:58.002676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 641/1307] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:57 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:24:59.025338 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-810982da-73ed-4190-9b5e-144de3110b7f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:24:59.025886 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-810982da-73ed-4190-9b5e-144de3110b7f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:24:59.079130 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-810982da-73ed-4190-9b5e-144de3110b7f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:24:59.085802 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-810982da-73ed-4190-9b5e-144de3110b7f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1094 microversion: 2.1 time: 0.064438 Aug 06 22:24:59.086351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 667/1308] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:24:59 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:00.107105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:00.107715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:00.115082 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:00.115562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:00.115996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:00.116719 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:00.117176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:00.117601 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:00.179216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:00.186674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-18cafd64-99ab-468f-b298-acd008574f7a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1144 microversion: 2.1 time: 0.083407 Aug 06 22:25:00.187253 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 642/1309] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:00 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:01.208658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:01.209268 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:01.216638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:01.217116 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:01.217545 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:01.218228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:01.218673 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:01.219085 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:01.279065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:01.286537 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d50bcaa7-8687-4889-8211-932080ff888a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1144 microversion: 2.1 time: 0.082502 Aug 06 22:25:01.287092 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 668/1310] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:01 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:02.307347 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:02.308085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:02.314751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:02.315302 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:02.316387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:02.317111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:02.317559 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:02.317982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:02.385604 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:02.393308 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c5d0df38-abec-4c3d-a80d-c17af77ac795 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1200 microversion: 2.1 time: 0.089931 Aug 06 22:25:02.404057 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 643/1311] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:02 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:03.414997 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:03.415591 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:03.422711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:03.423194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:03.423627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:03.424313 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:03.425018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:03.425649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:03.562515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:03.566267 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-2fd73c94-8810-4da9-a645-3a1440fe1253 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1277 microversion: 2.1 time: 0.155209 Aug 06 22:25:03.566830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 669/1312] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:03 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:03.934918 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-d6ca7f49-27b9-40b3-9aa5-cb7cb9294dba req-0a399c9c-368e-4fc8-84fd-8c1e8880bfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6e9d4b-2509-4926-9ce5-f9f47e711e65", "tag": "5d4efd18-f689-4073-bc55-c3a02f2a38e2"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:25:03.946124 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-d6ca7f49-27b9-40b3-9aa5-cb7cb9294dba req-0a399c9c-368e-4fc8-84fd-8c1e8880bfa8 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:03.946660 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-d6ca7f49-27b9-40b3-9aa5-cb7cb9294dba req-0a399c9c-368e-4fc8-84fd-8c1e8880bfa8 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:03.947088 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-d6ca7f49-27b9-40b3-9aa5-cb7cb9294dba req-0a399c9c-368e-4fc8-84fd-8c1e8880bfa8 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:03.959504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-d6ca7f49-27b9-40b3-9aa5-cb7cb9294dba req-0a399c9c-368e-4fc8-84fd-8c1e8880bfa8 service nova] Creating event network-changed:5d4efd18-f689-4073-bc55-c3a02f2a38e2 for instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 on hv-cinder-84984 Aug 06 22:25:03.964214 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-d6ca7f49-27b9-40b3-9aa5-cb7cb9294dba req-0a399c9c-368e-4fc8-84fd-8c1e8880bfa8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033120 Aug 06 22:25:03.964845 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 644/1313] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:25:04.587723 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:04.588417 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:04.595365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:04.595901 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:04.596658 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:04.597976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:04.598431 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:04.598858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:04.739897 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:04.747530 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a0fc839a-12df-477b-bfb1-bf8c3ce1a7bf tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.163754 Aug 06 22:25:04.748113 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 670/1314] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:04 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:05.770346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:05.771027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:05.777108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:05.777605 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:05.778032 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:05.778706 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:05.779153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:05.779566 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:05.908961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:05.917072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-99960d5e-c2ae-4f13-8ea2-54d15648d8d0 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.151420 Aug 06 22:25:05.917622 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 645/1315] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:05 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:06.938712 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:06.939326 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:06.941204 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:25:06.946493 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:06.946977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:06.947414 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:06.948104 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:06.948599 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:06.949031 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:07.081501 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:07.089009 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4a2c6ddb-bbe9-4085-a40f-d75ab89026c3 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.154225 Aug 06 22:25:07.089572 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 671/1316] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:06 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:08.110641 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:08.111271 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:08.114277 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:25:08.118969 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:08.119442 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:08.119920 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:08.120639 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:08.121085 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:08.121500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:08.250337 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:08.257805 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-95c21677-b304-497f-9772-b86ed763eb98 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.151028 Aug 06 22:25:08.258362 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 646/1317] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:08 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:09.278485 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:09.279097 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:09.281464 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=10 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:25:09.286434 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:09.286915 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:09.287344 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:09.288028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:09.288511 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:09.288933 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:09.423089 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:09.431348 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-43a9ecc4-0419-4772-a867-f8aa06de96c9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.156804 Aug 06 22:25:09.431937 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 672/1318] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:09 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:10.451769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:10.452377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:10.459457 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:10.459937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:10.460365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:10.461071 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:10.461516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:10.461936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:10.589760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:10.597398 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2b925a20-c000-422c-bade-dd7fba735e11 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.149521 Aug 06 22:25:10.597957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 647/1319] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:10 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:11.617284 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:11.617832 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:11.624307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:11.624815 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:11.625248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:11.625929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:11.626383 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:11.626804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:11.755559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:11.763019 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-51e24464-7e9c-4cc6-a3e0-975f5311c170 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.149667 Aug 06 22:25:11.763581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 673/1320] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:11 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:12.784367 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:12.785274 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:12.791256 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:12.791738 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:12.792171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:12.792895 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:12.793346 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:12.793770 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:12.928935 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:12.936672 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7999461b-de89-4c43-8230-dbcb8dd6eba9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.156717 Aug 06 22:25:12.937571 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 648/1321] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:12 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:13.957846 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:13.958486 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:13.964914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:13.965396 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:13.965828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:13.966514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:13.966962 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:13.967385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:14.095207 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:14.103473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-88a1aa2e-af84-4573-bb7b-70b9d68c876f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.149650 Aug 06 22:25:14.104027 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 674/1322] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:13 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:14.365782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-4ed59c05-9532-44a5-83dc-cfe64d6f4743 req-7c179e33-e7f3-4aa2-b874-b3bd4209daf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6e9d4b-2509-4926-9ce5-f9f47e711e65", "name": "network-vif-plugged", "status": "completed", "tag": "5d4efd18-f689-4073-bc55-c3a02f2a38e2"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:25:14.375630 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-4ed59c05-9532-44a5-83dc-cfe64d6f4743 req-7c179e33-e7f3-4aa2-b874-b3bd4209daf8 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:14.376103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-4ed59c05-9532-44a5-83dc-cfe64d6f4743 req-7c179e33-e7f3-4aa2-b874-b3bd4209daf8 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:14.376567 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-4ed59c05-9532-44a5-83dc-cfe64d6f4743 req-7c179e33-e7f3-4aa2-b874-b3bd4209daf8 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:14.387564 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-4ed59c05-9532-44a5-83dc-cfe64d6f4743 req-7c179e33-e7f3-4aa2-b874-b3bd4209daf8 service nova] Creating event network-vif-plugged:5d4efd18-f689-4073-bc55-c3a02f2a38e2 for instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 on hv-cinder-84984 Aug 06 22:25:14.392555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-4ed59c05-9532-44a5-83dc-cfe64d6f4743 req-7c179e33-e7f3-4aa2-b874-b3bd4209daf8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030607 Aug 06 22:25:14.393637 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 649/1323] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:25:15.124804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:15.125349 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:15.131965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:15.132473 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:15.132910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:15.133626 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:15.134078 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:15.134519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:15.264851 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:15.273212 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-86644f64-9d5e-4ecc-bd8f-13beb9619092 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.152301 Aug 06 22:25:15.273771 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 675/1324] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:15 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:16.295449 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:16.296143 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:16.303108 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:16.303585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:16.304017 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:16.304750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:16.305192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:16.310027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:16.439425 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:16.447477 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-da390d0e-1d08-492c-8193-71560ed9ea35 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1265 microversion: 2.1 time: 0.156758 Aug 06 22:25:16.448050 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 650/1325] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:16 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:17.469635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:17.470232 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:17.477018 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:17.477489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:17.477917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:17.478595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:17.479042 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:17.479456 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:17.611691 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:17.615049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-c9cbd2a3-2f62-457f-925f-aa7359a9655d tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1453 microversion: 2.1 time: 0.149288 Aug 06 22:25:17.615614 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 676/1326] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:17 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:17.634720 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:17.635330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:17.641701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:17.642184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:17.642617 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:17.643299 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:17.643750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:17.644178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:17.777368 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:17.785470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-71238dab-f0df-4e08-9f0f-dfe8ebb8a34a tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1453 microversion: 2.1 time: 0.153910 Aug 06 22:25:17.786173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 651/1327] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:17 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:20.135558 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-b299575a-1a6b-49b5-82f2-81b6bc005436 req-8c24eaff-34d5-4132-bfa4-a30cb2af6b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6e9d4b-2509-4926-9ce5-f9f47e711e65", "tag": "5d4efd18-f689-4073-bc55-c3a02f2a38e2"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:25:20.140688 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:25:20.159711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b299575a-1a6b-49b5-82f2-81b6bc005436 req-8c24eaff-34d5-4132-bfa4-a30cb2af6b83 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:20.159711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b299575a-1a6b-49b5-82f2-81b6bc005436 req-8c24eaff-34d5-4132-bfa4-a30cb2af6b83 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:20.159711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b299575a-1a6b-49b5-82f2-81b6bc005436 req-8c24eaff-34d5-4132-bfa4-a30cb2af6b83 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:20.159711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=77 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:25:20.159711 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-b299575a-1a6b-49b5-82f2-81b6bc005436 req-8c24eaff-34d5-4132-bfa4-a30cb2af6b83 service nova] Creating event network-changed:5d4efd18-f689-4073-bc55-c3a02f2a38e2 for instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 on hv-cinder-84984 Aug 06 22:25:20.165520 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-b299575a-1a6b-49b5-82f2-81b6bc005436 req-8c24eaff-34d5-4132-bfa4-a30cb2af6b83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152539 Aug 06 22:25:20.166115 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 677/1328] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:25:30.269298 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:25:30.269812 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Sat Aug 6 22:25:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:25:31.576180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:31.576961 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:31.579163 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:25:31.579823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:25:31.585116 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:31.585597 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:31.586028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:31.586713 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:31.587222 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:31.587711 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:31.768677 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lazy-loading 'services' on Instance uuid e4110040-c454-4dac-b519-30ef2b9e7c68 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:25:31.986112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-47e25a12-30cf-419f-a042-b2a2e41415ec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/os-volume_attachments/3db52911-6b12-417d-8125-247499996d2d" status: 202 len: 0 microversion: 2.1 time: 0.413780 Aug 06 22:25:31.986732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 652/1329] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:25:31 2022] DELETE /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/os-volume_attachments/3db52911-6b12-417d-8125-247499996d2d => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:25:33.003402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:25:33.004002 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:25:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:25:34.159153 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-af1efa1a-d94e-44fc-91df-e39ed42089e2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:25:34.166562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-af1efa1a-d94e-44fc-91df-e39ed42089e2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:34.167040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-af1efa1a-d94e-44fc-91df-e39ed42089e2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:34.167466 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-af1efa1a-d94e-44fc-91df-e39ed42089e2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:34.225705 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-af1efa1a-d94e-44fc-91df-e39ed42089e2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Going to try to stop instance {{(pid=118457) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 22:25:34.475532 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-af1efa1a-d94e-44fc-91df-e39ed42089e2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/action" status: 202 len: 0 microversion: 2.1 time: 0.320943 Aug 06 22:25:34.476122 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 678/1330] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:25:34 2022] POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:25:34.485167 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:34.485857 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:34.492885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:34.493355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:34.493781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:34.494479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:34.494926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:34.495354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:34.629272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:34.637356 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-2ad410f2-10b7-401d-8b39-9c1dd3d2f2f6 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.156893 Aug 06 22:25:34.637906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 653/1331] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:34 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:35.659461 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:35.660165 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:35.666591 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:35.667074 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:35.667507 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:35.668194 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:35.668671 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:35.669097 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:35.849203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:35.856879 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b4770839-ea83-436c-b0ec-37bd48938514 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.202122 Aug 06 22:25:35.857427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 679/1332] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:35 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:36.658172 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:25:36.658696 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Sat Aug 6 22:25:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:25:36.878387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:36.878996 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:36.885655 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:36.886132 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:36.886561 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:36.887293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:36.887739 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:36.888158 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:37.015974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:37.024218 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e9f59abf-8a8b-4905-97a7-7b424a69314e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.149671 Aug 06 22:25:37.024885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 654/1333] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:36 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:38.045439 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:38.046049 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:38.052371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:38.052871 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:38.054039 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:38.054726 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:38.055176 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:38.055595 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:38.185874 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:38.193374 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-cb19f668-7cd1-4304-b821-dbfa32886166 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.151806 Aug 06 22:25:38.193998 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 680/1334] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:38 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:39.214188 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:39.214789 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:39.221406 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:39.221885 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:39.222316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:39.223000 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:39.223453 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:39.223876 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:39.350157 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:39.357813 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-7c7e996b-07b2-4879-a312-bb9288bfebbb tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.147730 Aug 06 22:25:39.358379 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 655/1335] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:39 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:40.379107 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:40.379709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:40.386708 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:40.387272 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:40.387699 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:40.388378 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:40.388845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:40.389266 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:40.514223 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:40.521551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3bb9e898-13b2-40ef-9103-a72e7cceef65 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.146437 Aug 06 22:25:40.522698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 681/1336] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:40 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:41.543528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:41.544134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:41.550452 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:41.550926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:41.551354 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:41.552028 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:41.552503 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:41.552926 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:41.684153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:41.691491 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-45cc89e7-c6b0-431e-aefd-ebc0260ea8ba tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.151817 Aug 06 22:25:41.692047 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 656/1337] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:41 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:42.713031 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:42.713668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:42.719965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:42.720462 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:42.721149 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:42.721824 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:42.722267 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:42.722684 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:42.849024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:42.857256 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a4b21592-3ec3-4f9b-8071-6fd2f0517b2f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.148207 Aug 06 22:25:42.857816 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 682/1338] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:42 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:25:43.879269 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:43.879808 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:43.886623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:43.887112 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:43.887545 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:43.888234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:43.888718 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:43.889145 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:44.019446 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:44.027249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e01456be-90ef-42e2-bf1c-9bf00f2d0259 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.152097 Aug 06 22:25:44.027809 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 657/1339] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:43 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:45.048322 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:45.048977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:45.055497 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:45.055968 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:45.056395 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:45.057093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:45.057534 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:45.057948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:45.186100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:45.194090 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3ec4ce51-6464-48da-a6b9-c2fa4423e15a tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1679 microversion: 2.1 time: 0.149083 Aug 06 22:25:45.194657 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 683/1340] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:45 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:46.215519 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:46.216131 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:46.222824 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:46.223300 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:46.223731 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:46.224425 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:46.225758 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:46.226217 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:46.357459 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:46.365160 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fbe62ec8-2645-42bb-ad9e-89560b2995be tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1656 microversion: 2.1 time: 0.153403 Aug 06 22:25:46.365752 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 658/1341] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:46 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:46.385828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-13590f6d-9700-4e39-90d4-e933e2434f3f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:25:46.392318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13590f6d-9700-4e39-90d4-e933e2434f3f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:46.392817 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13590f6d-9700-4e39-90d4-e933e2434f3f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:46.393248 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-13590f6d-9700-4e39-90d4-e933e2434f3f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:46.415641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-13590f6d-9700-4e39-90d4-e933e2434f3f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Going to try to start instance {{(pid=118457) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 22:25:46.643628 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-13590f6d-9700-4e39-90d4-e933e2434f3f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/action" status: 202 len: 0 microversion: 2.1 time: 0.261379 Aug 06 22:25:46.644138 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 684/1342] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Aug 6 22:25:46 2022] POST /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:25:46.653037 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:46.653645 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:46.659414 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:46.659891 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:46.660320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:46.661024 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:46.661467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:46.661881 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:46.795192 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:46.803898 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1c2f640d-fa90-4c70-994d-0a2ff3698e13 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1665 microversion: 2.1 time: 0.154064 Aug 06 22:25:46.804479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 659/1343] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:46 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:47.826659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:47.827357 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:47.833649 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:47.834195 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:47.834809 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:47.835761 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:47.836215 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:47.836662 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:47.965949 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:47.973641 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ea672ce4-3eb5-4b68-b521-19ee26496cb7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1665 microversion: 2.1 time: 0.151748 Aug 06 22:25:47.974193 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 685/1344] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:47 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:25:48.995055 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:25:48.995644 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:25:49.002008 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:49.002483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:49.002912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:49.003583 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:25:49.004027 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:25:49.004467 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:25:49.134797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:25:49.142232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-c4acc0d5-eaf9-47a8-b76e-89413e3ef7fe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1669 microversion: 2.1 time: 0.151052 Aug 06 22:25:49.142822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 660/1345] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:25:48 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:44.945075 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:44.947285 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:44.950289 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=17 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:26:44.950960 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:26:44.955629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:44.956118 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:44.956612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:44.957332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:44.957785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:44.958236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:44.987864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-492bd11e-9ced-49aa-b5f6-2d19e2b6d157 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046636 Aug 06 22:26:44.988492 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 686/1346] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:26:44 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:26:45.049345 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:45.049841 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:45.051819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=18 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:26:45.052495 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:26:45.057102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:45.057578 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:45.058549 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:45.059377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:45.059822 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:45.060241 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:45.085469 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:26:45.370219 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4ad7bd5b-9f8a-48c3-be15-1a1d621c01d4 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 204 len: 0 microversion: 2.1 time: 0.324503 Aug 06 22:26:45.371389 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 661/1347] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:26:45 2022] DELETE /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:26:45.389793 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:45.390429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:45.396951 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:45.397429 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:45.397866 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:45.398543 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:45.399094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:45.399515 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:45.528292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:45.535551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d162ca63-a794-4e58-bd96-4c263c0183b3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1675 microversion: 2.1 time: 0.150641 Aug 06 22:26:45.536117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 687/1348] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:45 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:46.558533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:46.559257 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:46.565903 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:46.566383 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:46.566819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:46.567504 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:46.567990 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:46.568424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:46.701364 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:46.709355 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-fb40754c-7557-4d3c-9d86-fae2ff14278e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1675 microversion: 2.1 time: 0.155650 Aug 06 22:26:46.709917 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 662/1349] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:46 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:47.730763 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:47.731364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:47.738928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:47.739406 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:47.739837 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:47.740555 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:47.741003 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:47.741418 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:47.876331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:47.884010 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-20e40552-c222-4c2f-8144-71ab93b86b3b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1675 microversion: 2.1 time: 0.157144 Aug 06 22:26:47.884807 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 688/1350] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:47 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:48.502752 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-adcee1ae-a93d-4564-b417-a40408a52a9f req-c2fb8464-b96f-4d83-8108-73c3a8eb6abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4110040-c454-4dac-b519-30ef2b9e7c68", "name": "network-vif-deleted", "tag": "9383490b-8bb6-4fac-b09b-444e5daca958"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:26:48.513060 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-adcee1ae-a93d-4564-b417-a40408a52a9f req-c2fb8464-b96f-4d83-8108-73c3a8eb6abe service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:48.513750 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-adcee1ae-a93d-4564-b417-a40408a52a9f req-c2fb8464-b96f-4d83-8108-73c3a8eb6abe service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:48.514424 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-adcee1ae-a93d-4564-b417-a40408a52a9f req-c2fb8464-b96f-4d83-8108-73c3a8eb6abe service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:48.526785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-adcee1ae-a93d-4564-b417-a40408a52a9f req-c2fb8464-b96f-4d83-8108-73c3a8eb6abe service nova] Creating event network-vif-deleted:9383490b-8bb6-4fac-b09b-444e5daca958 for instance e4110040-c454-4dac-b519-30ef2b9e7c68 on hv-cinder-84984 Aug 06 22:26:48.531928 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-adcee1ae-a93d-4564-b417-a40408a52a9f req-c2fb8464-b96f-4d83-8108-73c3a8eb6abe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033259 Aug 06 22:26:48.532555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 663/1351] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:26:48.907205 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:48.907800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:48.913742 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:48.914218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:48.914683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:48.915373 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:48.915827 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:48.916245 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:48.947291 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:48.947769 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:48.948196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:48.948717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lazy-loading 'fault' on Instance uuid e4110040-c454-4dac-b519-30ef2b9e7c68 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:26:48.990312 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:48.998255 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9ac132cc-d2ce-46d0-8e57-5f064aeb4d20 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 200 len: 1328 microversion: 2.1 time: 0.095036 Aug 06 22:26:48.998867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 689/1352] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:48 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:50.019609 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:50.020310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:50.026936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:50.027982 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:50.028657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:50.029359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:50.029818 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:50.030237 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:50.043154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] HTTP exception thrown: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Request method failure captured: Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 HTTP/1.1 Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7umZhfQe35OgIv4uKKYLkBrgHgX1rzU_9l7ETBiRYYi--XmKRNboiJkO6A_Aasm9o0rOgeNiUDyfHacwZROpWrElH5-l6jj-GVE1a1hzHG_tH9Evp7AjKAgQAnsa0MkD64DJIp3czWNN0OCSy7jQPA6Qow_ayKCdRPFLDb4WK7BFhu0 Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:26:50.044762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8abd60d3224e4e2995d55417a73ffe58", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 563808cf212c40e2bd7f3ace5d1aec03 Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:26:50.046546 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': 'e4110040-c454-4dac-b519-30ef2b9e7c68'} Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:26:50.047701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:26:50.049439 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:26:50.051021 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Returning 404 to user: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:26:50.051021 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-4ef05cb2-d430-4aa3-ac47-b974f6cc8dfe tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 404 len: 111 microversion: 2.1 time: 0.030744 Aug 06 22:26:50.051021 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 664/1353] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:50 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:26:50.054806 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8535cfab-af39-42c6-a591-61c2549778ae tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '.version_select at 0x7f30c68cc3a0>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:50.165231 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8535cfab-af39-42c6-a591-61c2549778ae tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848524737" status: 202 len: 0 microversion: 2.1 time: 0.114114 Aug 06 22:26:50.165799 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 690/1354] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Aug 6 22:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848524737 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:26:50.978171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-48d30f9a-75e7-4bdc-bdd6-4a7deeded3b9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'create', calling method: .version_select at 0x7f30cb1740d0>, body: {"keypair": {"name": "tempest-keypair-15014524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9kC7e258flC7YMq0c0RdAkU4z0I71j5zFRTTUG+Tk4dZkA55RwWnRpqfgFjP8RCRCx8S4lxTeVD2TAijH+/IUGNVnggeLdCPryz4gzD+s8qvbOoUNnmVmMkEBYseI8kw=="}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:26:50.993480 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-48d30f9a-75e7-4bdc-bdd6-4a7deeded3b9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Getting quotas for project 8abd60d3224e4e2995d55417a73ffe58. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:26:50.997458 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-48d30f9a-75e7-4bdc-bdd6-4a7deeded3b9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Getting quotas for user 563808cf212c40e2bd7f3ace5d1aec03 and project 8abd60d3224e4e2995d55417a73ffe58. Resources: {'key_pairs'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:26:51.085146 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-48d30f9a-75e7-4bdc-bdd6-4a7deeded3b9 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.110824 Aug 06 22:26:51.085818 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 665/1355] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Aug 6 22:26:50 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:26:53.205867 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1709582814", "imageRef": "20f9cdb8-a07c-4223-83ea-bfd709080621", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b511bb86-dd65-46c9-bae6-b443acb1d0b4"}], "security_groups": [{"name": "tempest-securitygroup--132810511"}], "key_name": "tempest-keypair-15014524", "user_data": "}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:26:53.310436 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.network.neutron [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] validate_networks() for [('b511bb86-dd65-46c9-bae6-b443acb1d0b4', None, None, None, None, None)] {{(pid=118457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:26:53.671942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Flavor limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:26:53.672358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Image limits 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:26:53.672858 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Flavor pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:26:53.673261 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Image pref 0:0:0 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:26:53.673668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.virt.hardware [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:26:53.682264 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:53.682778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:53.683279 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:53.683995 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:53.684470 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:53.684969 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:53.702270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Getting quotas for project 8abd60d3224e4e2995d55417a73ffe58. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:26:53.706245 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.quota [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Getting quotas for user 563808cf212c40e2bd7f3ace5d1aec03 and project 8abd60d3224e4e2995d55417a73ffe58. Resources: {'instances', 'ram', 'cores'} {{(pid=118457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:26:53.717778 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Going to run 1 instances... {{(pid=118457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:26:53.720009 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20f9cdb8-a07c-4223-83ea-bfd709080621',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:26:53.906664 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ccfe2da5-a3fe-4180-adbf-a9f21dd29b52 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.705709 Aug 06 22:26:53.907223 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 691/1356] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:26:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:26:53.918699 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6147c011-1beb-4e64-b76c-9f7748b841fa tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:53.919362 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6147c011-1beb-4e64-b76c-9f7748b841fa tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:53.973094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6147c011-1beb-4e64-b76c-9f7748b841fa tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:53.979713 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6147c011-1beb-4e64-b76c-9f7748b841fa tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1236 microversion: 2.1 time: 0.065428 Aug 06 22:26:53.980272 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 666/1357] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:53 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:55.001678 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5b850f62-9f72-43ee-880e-84665213d619 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:55.002284 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5b850f62-9f72-43ee-880e-84665213d619 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:55.053745 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5b850f62-9f72-43ee-880e-84665213d619 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:55.061255 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5b850f62-9f72-43ee-880e-84665213d619 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1236 microversion: 2.1 time: 0.063997 Aug 06 22:26:55.061801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 692/1358] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:54 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:56.081715 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-29179fe4-1850-4816-8437-75e1eec5cb3e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:56.082329 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-29179fe4-1850-4816-8437-75e1eec5cb3e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:56.138513 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-29179fe4-1850-4816-8437-75e1eec5cb3e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:56.145757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-29179fe4-1850-4816-8437-75e1eec5cb3e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1236 microversion: 2.1 time: 0.067821 Aug 06 22:26:56.146309 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 667/1359] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:56 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:26:57.166938 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b889423c-638e-4bdd-8ede-709660f4cfec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:57.167630 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b889423c-638e-4bdd-8ede-709660f4cfec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:57.220096 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-b889423c-638e-4bdd-8ede-709660f4cfec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:57.226913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b889423c-638e-4bdd-8ede-709660f4cfec tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1236 microversion: 2.1 time: 0.063753 Aug 06 22:26:57.227474 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 693/1360] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:57 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:58.251385 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:58.251987 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:58.259019 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:58.259491 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:58.259918 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:58.260648 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:58.261113 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:58.261529 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:58.321119 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:58.328356 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-80ccf9fe-5ef8-49e1-976a-be5d4a2e5a41 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1240 microversion: 2.1 time: 0.080836 Aug 06 22:26:58.328931 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 668/1361] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:58 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:26:59.349345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:26:59.349882 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:26:59.357635 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:59.358117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:59.358656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:59.359359 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:26:59.359795 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:26:59.360218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:26:59.422095 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:26:59.429526 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-5de8fc6e-65ba-4953-9da4-a3530b5ef995 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1288 microversion: 2.1 time: 0.084376 Aug 06 22:26:59.430086 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 694/1362] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:26:59 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:00.451353 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:00.451968 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:00.458426 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:00.458912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:00.459339 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:00.460053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:00.460532 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:00.460957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:00.528221 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:00.535676 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-95194850-dc19-4045-adb1-8d676df26a8b tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1294 microversion: 2.1 time: 0.088984 Aug 06 22:27:00.537704 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 669/1363] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:00 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:01.556661 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:01.557332 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:01.565259 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:01.566230 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:01.566663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:01.567424 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:01.567895 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:01.568588 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:01.659898 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-da393a5d-762e-4e53-8dfd-93b24c9ea234 req-d7b224e9-0a22-4ca4-a8a4-9e4e6577d53a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f15d1b-c62f-4355-8af8-b7ae3474e0c0", "tag": "2b6342e1-f7df-4435-abd4-9777491d362e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:27:01.672717 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-da393a5d-762e-4e53-8dfd-93b24c9ea234 req-d7b224e9-0a22-4ca4-a8a4-9e4e6577d53a service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:01.677999 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-da393a5d-762e-4e53-8dfd-93b24c9ea234 req-d7b224e9-0a22-4ca4-a8a4-9e4e6577d53a service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:01.677999 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-da393a5d-762e-4e53-8dfd-93b24c9ea234 req-d7b224e9-0a22-4ca4-a8a4-9e4e6577d53a service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:01.686320 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-da393a5d-762e-4e53-8dfd-93b24c9ea234 req-d7b224e9-0a22-4ca4-a8a4-9e4e6577d53a service nova] Creating event network-changed:2b6342e1-f7df-4435-abd4-9777491d362e for instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 on hv-cinder-84984 Aug 06 22:27:01.691723 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-da393a5d-762e-4e53-8dfd-93b24c9ea234 req-d7b224e9-0a22-4ca4-a8a4-9e4e6577d53a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125551 Aug 06 22:27:01.692593 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 670/1364] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:27:01.731957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:01.740954 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ed354e7f-3d28-49c3-a029-1cd253212cea tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1361 microversion: 2.1 time: 0.187389 Aug 06 22:27:01.740954 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 695/1365] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:01 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:02.765618 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:02.766290 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:02.772374 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:02.772875 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:02.773322 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:02.773990 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:02.774433 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:02.774851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:02.906304 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:02.913785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-82bd7c40-0a02-49e8-92ae-12ba74dd9baf tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1361 microversion: 2.1 time: 0.152951 Aug 06 22:27:02.914353 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 671/1366] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:02 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:03.935914 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:03.936505 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:03.938741 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:03.943463 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:03.943940 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:03.944365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:03.945068 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:03.945512 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:03.945927 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:04.071946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:04.079952 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9fdd1a6f-0b1a-4d11-878c-0ad109137033 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1361 microversion: 2.1 time: 0.148732 Aug 06 22:27:04.080531 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 696/1367] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:03 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:05.100506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:05.102293 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:05.108270 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:05.108774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:05.109209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:05.109943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:05.110403 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:05.110801 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:05.240115 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:05.248103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5bce8e44-e877-4769-9dbe-6c45c986a584 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1361 microversion: 2.1 time: 0.151481 Aug 06 22:27:05.248843 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 672/1368] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:05 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:06.268892 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:06.269505 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:06.276119 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:06.276628 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:06.277069 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:06.278321 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:06.279000 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:06.279430 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:06.412663 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:06.420162 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0e2ea243-43f5-42e8-8fab-c15063abd738 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1361 microversion: 2.1 time: 0.155085 Aug 06 22:27:06.420757 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 697/1369] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:06 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:07.124902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-c68d6eea-79ef-4bd3-b8b7-8b6fa0aca43c req-d4f5a258-d786-48c8-bc94-28c05bf7356a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f15d1b-c62f-4355-8af8-b7ae3474e0c0", "name": "network-vif-plugged", "status": "completed", "tag": "2b6342e1-f7df-4435-abd4-9777491d362e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:27:07.130326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=8 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:07.135456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-c68d6eea-79ef-4bd3-b8b7-8b6fa0aca43c req-d4f5a258-d786-48c8-bc94-28c05bf7356a service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:07.140122 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-c68d6eea-79ef-4bd3-b8b7-8b6fa0aca43c req-d4f5a258-d786-48c8-bc94-28c05bf7356a service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:07.140122 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-c68d6eea-79ef-4bd3-b8b7-8b6fa0aca43c req-d4f5a258-d786-48c8-bc94-28c05bf7356a service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:07.147751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-c68d6eea-79ef-4bd3-b8b7-8b6fa0aca43c req-d4f5a258-d786-48c8-bc94-28c05bf7356a service nova] Creating event network-vif-plugged:2b6342e1-f7df-4435-abd4-9777491d362e for instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 on hv-cinder-84984 Aug 06 22:27:07.152547 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-c68d6eea-79ef-4bd3-b8b7-8b6fa0aca43c req-d4f5a258-d786-48c8-bc94-28c05bf7356a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Aug 06 22:27:07.153216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 673/1370] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:27:07.441028 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:07.441645 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:07.443559 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=10 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:07.448919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:07.449405 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:07.449928 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:07.450633 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:07.451110 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:07.451523 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:07.587751 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:07.595957 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-25a57384-ecfc-432a-9ff6-e152a7910417 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1361 microversion: 2.1 time: 0.158818 Aug 06 22:27:07.596569 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 698/1371] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:07 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:08.617771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:08.618387 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:08.625616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:08.626095 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:08.626528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:08.627209 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:08.627656 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:08.628076 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:08.760705 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:08.768122 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b76aa019-e4c8-428e-a63f-ef64ad6eec77 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1361 microversion: 2.1 time: 0.155201 Aug 06 22:27:08.768732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 674/1372] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:08 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:09.788622 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:09.789228 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:09.795798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:09.796251 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:09.796706 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:09.797384 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:09.797830 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:09.798247 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:09.924305 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:09.931668 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4d62c0d7-ec53-48f6-8677-dd9284efa518 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1548 microversion: 2.1 time: 0.146904 Aug 06 22:27:09.932205 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 699/1373] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:09 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:09.952932 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:09.953473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:09.959858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:09.960338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:09.960802 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:09.961487 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:09.961938 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:09.962359 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:10.036774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-eb5fe238-d84e-4ad7-aec8-e6bdba14be0c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088413 Aug 06 22:27:10.037362 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 675/1374] 10.222.0.18 () {58 vars in 1275 bytes} [Sat Aug 6 22:27:09 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:27:11.263361 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-62fd01ca-110b-4ff8-aaff-44a542fedf4e req-22e29529-bd54-4237-8fba-83c92974c3ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f15d1b-c62f-4355-8af8-b7ae3474e0c0", "tag": "2b6342e1-f7df-4435-abd4-9777491d362e"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:27:11.273623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-62fd01ca-110b-4ff8-aaff-44a542fedf4e req-22e29529-bd54-4237-8fba-83c92974c3ef service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:11.274180 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-62fd01ca-110b-4ff8-aaff-44a542fedf4e req-22e29529-bd54-4237-8fba-83c92974c3ef service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:11.274682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-62fd01ca-110b-4ff8-aaff-44a542fedf4e req-22e29529-bd54-4237-8fba-83c92974c3ef service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:11.285611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-62fd01ca-110b-4ff8-aaff-44a542fedf4e req-22e29529-bd54-4237-8fba-83c92974c3ef service nova] Creating event network-changed:2b6342e1-f7df-4435-abd4-9777491d362e for instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 on hv-cinder-84984 Aug 06 22:27:11.290652 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-62fd01ca-110b-4ff8-aaff-44a542fedf4e req-22e29529-bd54-4237-8fba-83c92974c3ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031677 Aug 06 22:27:11.291412 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 700/1375] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:27:20.512491 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:20.513282 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:20.517153 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-9607263", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898913352", "security_groups": [{"name": "tempest-secgroup-smoke-304693870"}], "block_device_mapping_v2": [{"uuid": "ecf358b5-ee72-4f8e-bde5-891c56f13386", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "356b570d-9374-438e-9b29-c0fd0612d386"}]}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:27:20.630102 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.network.neutron [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] validate_networks() for [('356b570d-9374-438e-9b29-c0fd0612d386', None, None, None, None, None)] {{(pid=118456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:27:21.039823 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Flavor limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:27:21.040248 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Image limits 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:27:21.040763 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Flavor pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:27:21.041173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Image pref 0:0:0 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:27:21.041585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.virt.hardware [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:27:21.050324 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:21.050798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:21.051227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:21.051943 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:21.052390 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:21.052849 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:21.069900 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Getting quotas for project 8168ba3e30a743a582d1c182ca2423b3. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:27:21.074512 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.quota [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Getting quotas for user 2dae6a7ec4404626b75a6702386d091b and project 8168ba3e30a743a582d1c182ca2423b3. Resources: {'instances', 'ram', 'cores'} {{(pid=118456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:27:21.130130 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Going to run 1 instances... {{(pid=118456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:27:21.132191 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ecf358b5-ee72-4f8e-bde5-891c56f13386',volume_size=None,volume_type=None)] {{(pid=118456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:27:21.551796 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f3ade5aa-8b0b-4eb4-bf25-17bad3598287 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.040763 Aug 06 22:27:21.552506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 676/1376] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Aug 6 22:27:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:27:21.562050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:21.562792 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=66 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:21.567710 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bf60b1b7-2916-4242-8b7e-b4154e65c9ad tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:21.568615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bf60b1b7-2916-4242-8b7e-b4154e65c9ad tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:21.623175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bf60b1b7-2916-4242-8b7e-b4154e65c9ad tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:21.633732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bf60b1b7-2916-4242-8b7e-b4154e65c9ad tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1091 microversion: 2.1 time: 0.072745 Aug 06 22:27:21.633732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 701/1377] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:21 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1091 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:22.654757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:22.655352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:22.661352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:22.661837 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:22.662267 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:22.662957 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:22.663401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:22.663821 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:22.726176 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:22.733896 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-06d681d3-8140-4f8f-a403-d3cb68b7ae01 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1141 microversion: 2.1 time: 0.083512 Aug 06 22:27:22.735824 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 677/1378] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:22 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1141 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:23.755621 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:23.761117 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:23.764163 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:23.764676 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:23.765305 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:23.766190 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:23.766667 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:23.767093 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:23.830130 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:23.841967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a0dd744a-2a40-43de-8498-d79e5b805320 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1197 microversion: 2.1 time: 0.087034 Aug 06 22:27:23.841967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 702/1379] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:23 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:24.860771 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:24.861403 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:24.867743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:24.868213 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:24.868670 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:24.869343 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:24.869788 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:24.870232 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:25.009111 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:25.017562 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-10306971-7637-493f-b38c-1664bb0f5497 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1274 microversion: 2.1 time: 0.161160 Aug 06 22:27:25.018337 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 678/1380] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:24 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:27:25.206556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-53f26e95-85a5-4a35-8fd5-b666ed41cbda req-820fa845-bdad-4a18-8602-b87dfa052bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c020c89-17d2-4bd3-acae-617ae1bd6407", "tag": "6e292602-2d21-4309-8de2-725f38b1e86e"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:27:25.210819 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-53f26e95-85a5-4a35-8fd5-b666ed41cbda req-820fa845-bdad-4a18-8602-b87dfa052bbe service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:25.211299 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-53f26e95-85a5-4a35-8fd5-b666ed41cbda req-820fa845-bdad-4a18-8602-b87dfa052bbe service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:25.211798 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-53f26e95-85a5-4a35-8fd5-b666ed41cbda req-820fa845-bdad-4a18-8602-b87dfa052bbe service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:25.223050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-53f26e95-85a5-4a35-8fd5-b666ed41cbda req-820fa845-bdad-4a18-8602-b87dfa052bbe service nova] Creating event network-changed:6e292602-2d21-4309-8de2-725f38b1e86e for instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 on hv-cinder-84984 Aug 06 22:27:25.227977 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-53f26e95-85a5-4a35-8fd5-b666ed41cbda req-820fa845-bdad-4a18-8602-b87dfa052bbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031222 Aug 06 22:27:25.228779 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 703/1381] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:27:26.039252 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:26.039797 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:26.046666 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:26.047154 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:26.047584 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:26.048268 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:26.048749 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:26.049173 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:26.178621 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:26.186263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f9105207-f59b-4a75-bfe5-e55656b9e7fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.151103 Aug 06 22:27:26.187907 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 679/1382] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:26 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:27.208034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:27.208755 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:27.214893 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:27.215370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:27.216307 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:27.217016 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:27.217469 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:27.217908 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:27.350948 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:27.359238 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-d73e297b-f4cf-47b8-9591-a40f9dc946b5 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.155864 Aug 06 22:27:27.359801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 704/1383] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:27 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:28.380025 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:28.380663 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:28.387129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:28.387743 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:28.388180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:28.388902 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:28.389352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:28.389781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:28.518815 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:28.526506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-eac283c9-5609-4de7-b423-b6e43e57c527 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.150335 Aug 06 22:27:28.527004 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 680/1384] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:28 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:29.547913 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:29.548546 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:29.554887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:29.555371 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:29.555799 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:29.556517 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:29.556965 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:29.557385 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:29.685451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:29.693073 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ea3da255-75a8-4420-98f8-175b556420b6 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.149616 Aug 06 22:27:29.693637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 705/1385] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:29 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:30.713114 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:30.713722 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:30.721181 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:30.721656 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:30.722087 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:30.722765 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:30.723212 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:30.723631 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:30.854586 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:30.862282 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3fc42f79-954e-41fe-9beb-5080bef843ec tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.152975 Aug 06 22:27:30.864557 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 681/1386] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:30 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:31.884094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:31.884738 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:31.887638 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell0:SELECT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:31.892465 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:31.892887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:31.893323 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:31.894001 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:31.894447 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:31.894863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:32.027560 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:32.035783 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-338ecab3-9bc2-43ca-b5e2-c3ba981ea4ae tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.155560 Aug 06 22:27:32.036362 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 706/1387] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:31 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:33.056886 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:33.057454 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:33.059873 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:33.060580 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell0:SELECT=6 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:27:33.065729 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:33.066215 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:33.066653 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:33.067352 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:33.067804 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:33.068230 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:33.201788 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:33.209349 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0629b7d8-43ca-4efc-8a2e-d3d808c875c7 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.156493 Aug 06 22:27:33.209919 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 682/1388] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:33 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:34.230312 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:34.231480 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:34.237927 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:34.238413 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:34.238849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:34.239547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:34.239987 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:34.240435 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:34.369211 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:34.377287 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e8233b26-2f8f-4f30-912d-21936b28e143 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.150905 Aug 06 22:27:34.377845 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 707/1389] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:34 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:35.218858 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-6f855d5f-75c9-40bd-a259-4a4ded0f99ba req-884c47f4-612c-4862-af1b-ea5617424ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c020c89-17d2-4bd3-acae-617ae1bd6407", "name": "network-vif-plugged", "status": "completed", "tag": "6e292602-2d21-4309-8de2-725f38b1e86e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:27:35.228348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6f855d5f-75c9-40bd-a259-4a4ded0f99ba req-884c47f4-612c-4862-af1b-ea5617424ed2 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:35.228853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6f855d5f-75c9-40bd-a259-4a4ded0f99ba req-884c47f4-612c-4862-af1b-ea5617424ed2 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:35.231820 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-6f855d5f-75c9-40bd-a259-4a4ded0f99ba req-884c47f4-612c-4862-af1b-ea5617424ed2 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:35.240062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-6f855d5f-75c9-40bd-a259-4a4ded0f99ba req-884c47f4-612c-4862-af1b-ea5617424ed2 service nova] Creating event network-vif-plugged:6e292602-2d21-4309-8de2-725f38b1e86e for instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 on hv-cinder-84984 Aug 06 22:27:35.245013 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-6f855d5f-75c9-40bd-a259-4a4ded0f99ba req-884c47f4-612c-4862-af1b-ea5617424ed2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086079 Aug 06 22:27:35.245585 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 683/1390] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:27:35.398611 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:35.399203 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:35.405618 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:35.406100 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:35.406534 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:35.407218 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:35.407669 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:35.408091 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:35.546585 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:35.558329 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f4de11d7-9f8b-484a-a7e9-5977a81ed3af tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.159455 Aug 06 22:27:35.558329 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 708/1391] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:35 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:36.576798 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:36.577501 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:36.583615 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:36.584094 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:36.584558 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:36.585243 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:36.585695 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:36.586117 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:36.724555 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:36.726890 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-42a33052-ef0e-450e-b793-0e9a9083e213 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1262 microversion: 2.1 time: 0.155378 Aug 06 22:27:36.727442 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 684/1392] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:36 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:37.747556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:37.748160 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:37.754487 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:37.754959 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:37.755382 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:37.756059 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:37.756534 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:37.757021 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:37.886268 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:37.893808 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0f8b7a95-d533-4884-9663-891e80db7998 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1450 microversion: 2.1 time: 0.150550 Aug 06 22:27:37.894367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 709/1393] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:37 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:27:37.913454 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:27:37.914059 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:27:37.921241 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:37.921657 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:37.922081 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:37.922995 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:37.923449 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:37.923865 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:38.055736 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:27:38.063930 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-e6e4f43a-255e-4041-8932-dc04b247166f tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1450 microversion: 2.1 time: 0.154345 Aug 06 22:27:38.064517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 685/1394] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:27:37 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:27:40.269804 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-363a1d1f-a9b0-4323-a9da-b38dd4f1ddf7 req-b746e626-20ac-4146-9092-42b15aeaef0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c020c89-17d2-4bd3-acae-617ae1bd6407", "tag": "6e292602-2d21-4309-8de2-725f38b1e86e"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:27:40.280060 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-363a1d1f-a9b0-4323-a9da-b38dd4f1ddf7 req-b746e626-20ac-4146-9092-42b15aeaef0f service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:27:40.280561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-363a1d1f-a9b0-4323-a9da-b38dd4f1ddf7 req-b746e626-20ac-4146-9092-42b15aeaef0f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:27:40.281007 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-363a1d1f-a9b0-4323-a9da-b38dd4f1ddf7 req-b746e626-20ac-4146-9092-42b15aeaef0f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:27:40.291959 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-363a1d1f-a9b0-4323-a9da-b38dd4f1ddf7 req-b746e626-20ac-4146-9092-42b15aeaef0f service nova] Creating event network-changed:6e292602-2d21-4309-8de2-725f38b1e86e for instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 on hv-cinder-84984 Aug 06 22:27:40.297033 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-363a1d1f-a9b0-4323-a9da-b38dd4f1ddf7 req-b746e626-20ac-4146-9092-42b15aeaef0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031198 Aug 06 22:27:40.297615 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 710/1395] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:26.182744 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:28:26.183518 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=52 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:28:26.233262 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:26.240216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:26.240216 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:26.240577 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:26.241014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:26.241701 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:26.242152 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:26.242571 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:26.265834 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1bb1277f-3c4c-437a-b6a3-c8386a797492 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/ips" status: 200 len: 146 microversion: 2.1 time: 0.088030 Aug 06 22:28:26.266373 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 686/1396] 10.222.0.18 () {58 vars in 1248 bytes} [Sat Aug 6 22:28:26 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/ips => generated 146 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:27.849863 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=22 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:28:27.850608 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=46 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:28:27.854917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4ef588a-fb3e-4850-a5a6-fc8ddca414a8"}} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:28:27.857345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:27.863454 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:27.863930 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:27.864368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:27.865197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:27.865651 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:27.866070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:28.707873 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-6f18f6d5-3e1d-4ac6-96e9-a61f1ece3666 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859504 Aug 06 22:28:28.708565 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 711/1397] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:28:27 2022] POST /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:28:37.277051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:37.279282 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:37.281762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=4 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:28:37.287225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:37.287709 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:37.288148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:37.288877 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:37.289333 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:37.289761 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:37.319062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b68be31d-53e2-4409-bdec-46330ea376a3 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Aug 06 22:28:37.319602 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 687/1398] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:28:37 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:37.331813 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:37.332387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:37.338483 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:37.338960 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:37.339392 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:37.340070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:37.340551 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:37.340971 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:37.370387 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-35655fa4-8f40-48ff-bd5a-6e2b13a03bd2 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/b4ef588a-fb3e-4850-a5a6-fc8ddca414a8" status: 200 len: 194 microversion: 2.1 time: 0.044024 Aug 06 22:28:37.370966 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 712/1399] 10.222.0.18 () {58 vars in 1413 bytes} [Sat Aug 6 22:28:37 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/b4ef588a-fb3e-4850-a5a6-fc8ddca414a8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:38.999133 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4608ecb8-c0fc-493e-aabe-affd57d285c8"}} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:28:39.001782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:39.008732 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:39.009217 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:39.009646 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:39.010330 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:39.010781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:39.011203 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:39.730297 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-0391b5e5-ed51-4f08-aa74-8493c1127882 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "POST /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735038 Aug 06 22:28:39.730912 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 688/1400] 10.222.0.18 () {60 vars in 1323 bytes} [Sat Aug 6 22:28:38 2022] POST /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:48.473917 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:48.476137 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:48.478644 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=4 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:28:48.479319 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:28:48.483887 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:48.484365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:48.484823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:48.485506 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:48.485961 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:48.486381 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:48.516670 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-9fc5ff7b-adfa-48f3-9e7c-424c6074834d tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046892 Aug 06 22:28:48.517213 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 713/1401] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:28:48 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:48.653530 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:48.654106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:48.661316 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:48.661796 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:48.662234 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:48.662915 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:48.663365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:48.663785 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:48.693365 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ce32f2eb-cd63-41ef-86dd-327062119e25 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/b4ef588a-fb3e-4850-a5a6-fc8ddca414a8" status: 200 len: 194 microversion: 2.1 time: 0.044444 Aug 06 22:28:48.693947 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 689/1402] 10.222.0.18 () {58 vars in 1413 bytes} [Sat Aug 6 22:28:48 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/b4ef588a-fb3e-4850-a5a6-fc8ddca414a8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:48.703976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:48.704489 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:48.711050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:48.711527 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:48.711955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:48.712667 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:48.713118 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:48.713547 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:48.792145 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lazy-loading 'services' on Instance uuid b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:28:48.999409 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-0347fa06-4f9f-47c3-8c88-ffb589bc6840 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/b4ef588a-fb3e-4850-a5a6-fc8ddca414a8" status: 202 len: 0 microversion: 2.1 time: 0.299066 Aug 06 22:28:48.999997 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 714/1403] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:28:48 2022] DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/b4ef588a-fb3e-4850-a5a6-fc8ddca414a8 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:28:51.173597 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:51.174171 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:51.180617 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:51.181099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:51.181533 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:51.182225 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:51.182675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:51.183096 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:51.212065 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-ea2e426d-b7df-4128-8906-4afbdcc1d91f tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/4608ecb8-c0fc-493e-aabe-affd57d285c8" status: 200 len: 194 microversion: 2.1 time: 0.042435 Aug 06 22:28:51.212675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 690/1404] 10.222.0.18 () {58 vars in 1413 bytes} [Sat Aug 6 22:28:51 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/4608ecb8-c0fc-493e-aabe-affd57d285c8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:51.224196 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:51.224800 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:51.230878 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:51.231355 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:51.231786 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:51.232494 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:51.232946 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:51.233365 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:51.315075 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lazy-loading 'services' on Instance uuid b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:28:51.516963 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-dd9ede2a-cf05-459d-93a1-42e07396ab49 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/4608ecb8-c0fc-493e-aabe-affd57d285c8" status: 202 len: 0 microversion: 2.1 time: 0.297462 Aug 06 22:28:51.517540 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 715/1405] 10.222.0.18 () {58 vars in 1416 bytes} [Sat Aug 6 22:28:51 2022] DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments/4608ecb8-c0fc-493e-aabe-affd57d285c8 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:28:52.688127 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:52.690958 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:52.698184 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:52.702384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:52.702384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:52.702384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:52.702384 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:52.702853 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:52.731310 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-26aa4ea2-10f2-4b09-b6c4-d3e784c5f442 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048001 Aug 06 22:28:52.731991 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 691/1406] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:28:52 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:28:52.845108 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:52.847345 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:52.853459 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:52.853942 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:52.854370 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:52.855050 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:52.855501 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:52.855925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:52.884152 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-3470daf8-456a-4fce-9205-e4e93e8af929 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044052 Aug 06 22:28:52.884725 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 716/1407] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Aug 6 22:28:52 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 22:28:52.945428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:52.945963 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:52.951860 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:52.952620 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:52.953093 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:52.953792 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:52.954251 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:52.954675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:52.980755 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:28:53.341041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b0289b75-3b03-4295-bfc5-56cef2dad6a7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 204 len: 0 microversion: 2.1 time: 0.399097 Aug 06 22:28:53.341632 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 692/1408] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:28:52 2022] DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:28:53.350318 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:53.350925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:53.357011 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:53.357491 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:53.357923 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:53.358612 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:53.359062 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:53.359482 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:53.491519 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:28:53.499031 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-588ac27e-f102-40d6-ba39-a5f557dd36b5 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1672 microversion: 2.1 time: 0.152840 Aug 06 22:28:53.499581 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 717/1409] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:28:53 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:28:54.521249 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:54.521974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:54.528315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:54.528849 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:54.529278 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:54.529983 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:54.530428 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:54.530847 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:54.657863 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:28:54.665964 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6f18359a-36ca-4e04-9e2b-bd94eb1c2d1c tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1672 microversion: 2.1 time: 0.149550 Aug 06 22:28:54.666517 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 693/1410] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:28:54 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:28:55.687015 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:55.687627 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:55.694082 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:55.694573 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:55.695011 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:55.695709 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:55.696164 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:55.696637 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:55.829201 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:28:55.836906 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f2bce273-379a-4d6a-8d1f-eb86b2480ca1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1672 microversion: 2.1 time: 0.153780 Aug 06 22:28:55.837477 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 718/1411] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:28:55 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:28:56.712608 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-5cfee2dc-62f4-4e7b-9a2b-81acad4fbe7d req-b234d221-db76-4348-9ce9-d4327f62c640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f15d1b-c62f-4355-8af8-b7ae3474e0c0", "name": "network-vif-deleted", "tag": "2b6342e1-f7df-4435-abd4-9777491d362e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:28:56.722762 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-5cfee2dc-62f4-4e7b-9a2b-81acad4fbe7d req-b234d221-db76-4348-9ce9-d4327f62c640 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:56.724906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-5cfee2dc-62f4-4e7b-9a2b-81acad4fbe7d req-b234d221-db76-4348-9ce9-d4327f62c640 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:56.724906 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-5cfee2dc-62f4-4e7b-9a2b-81acad4fbe7d req-b234d221-db76-4348-9ce9-d4327f62c640 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:56.734663 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-5cfee2dc-62f4-4e7b-9a2b-81acad4fbe7d req-b234d221-db76-4348-9ce9-d4327f62c640 service nova] Creating event network-vif-deleted:2b6342e1-f7df-4435-abd4-9777491d362e for instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 on hv-cinder-84984 Aug 06 22:28:56.740391 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-5cfee2dc-62f4-4e7b-9a2b-81acad4fbe7d req-b234d221-db76-4348-9ce9-d4327f62c640 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Aug 06 22:28:56.741255 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 694/1412] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:28:56.858810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:56.860026 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:56.866829 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:56.867309 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:56.867740 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:56.868448 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:56.868953 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:56.869368 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:56.940967 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563808cf212c40e2bd7f3ace5d1aec03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd60d3224e4e2995d55417a73ffe58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:28:56.949364 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-bc4ce06f-f1c4-42d4-ae6d-1edca3b2b7b7 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 200 len: 1321 microversion: 2.1 time: 0.094731 Aug 06 22:28:56.949929 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 719/1413] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:28:56 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:28:57.972473 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:57.973165 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:28:57.979233 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:57.979689 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:57.980119 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:57.980889 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:28:57.981338 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:28:57.981754 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:28:57.994577 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] HTTP exception thrown: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Request method failure captured: Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 HTTP/1.1 Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7umZhfQe35OgIv4uKKYLkBrgHgX1rzU_9l7ETBiRYYi--XmKRNboiJkO6A_Aasm9o0rOgeNiUDyfHacwZROpWrElH5-l6jj-GVE1a1hzHG_tH9Evp7AjKAgQAnsa0MkD64DJIp3czWNN0OCSy7jQPA6Qow_ayKCdRPFLDb4WK7BFhu0 Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:28:57.996150 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8abd60d3224e4e2995d55417a73ffe58", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 563808cf212c40e2bd7f3ace5d1aec03 Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:28:57.997986 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': 'b4f15d1b-c62f-4355-8af8-b7ae3474e0c0'} Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:28:57.999200 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:28:58.000994 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:28:58.003315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Returning 404 to user: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:28:58.003315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b97d5220-0ba4-447f-bea7-abe51623c6ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 404 len: 111 microversion: 2.1 time: 0.030054 Aug 06 22:28:58.003315 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 695/1414] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:28:57 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:28:58.008542 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-e3e631f9-8672-48a6-99f0-bacd9c510199 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '.version_select at 0x7f30c6c36e50>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:28:58.081123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-e3e631f9-8672-48a6-99f0-bacd9c510199 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-15014524" status: 202 len: 0 microversion: 2.1 time: 0.075680 Aug 06 22:28:58.081685 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 720/1415] 10.222.0.18 () {58 vars in 1215 bytes} [Sat Aug 6 22:28:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-15014524 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:29:01.446369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:01.446880 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:01.453254 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:01.453729 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:01.454156 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:01.454835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:01.455278 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:01.456208 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:01.469286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] HTTP exception thrown: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Request method failure captured: Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 HTTP/1.1 Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7umZhfQe35OgIv4uKKYLkBrgHgX1rzU_9l7ETBiRYYi--XmKRNboiJkO6A_Aasm9o0rOgeNiUDyfHacwZROpWrElH5-l6jj-GVE1a1hzHG_tH9Evp7AjKAgQAnsa0MkD64DJIp3czWNN0OCSy7jQPA6Qow_ayKCdRPFLDb4WK7BFhu0 Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:29:01.471054 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8abd60d3224e4e2995d55417a73ffe58", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 563808cf212c40e2bd7f3ace5d1aec03 Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.473401 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': 'b4f15d1b-c62f-4355-8af8-b7ae3474e0c0'} Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:29:01.474500 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.476106 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.479913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Returning 404 to user: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:29:01.479913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-17804021-43ba-4324-a133-7eb0cef4ce5e tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 404 len: 111 microversion: 2.1 time: 0.030502 Aug 06 22:29:01.479913 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 696/1416] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:29:01 2022] DELETE /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:29:01.482040 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:01.482642 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: b4f15d1b-c62f-4355-8af8-b7ae3474e0c0] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:01.489623 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:01.490112 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:01.490549 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:01.491292 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:01.491695 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:01.492120 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:01.505351 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] HTTP exception thrown: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Request method failure captured: Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 HTTP/1.1 Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7umZhfQe35OgIv4uKKYLkBrgHgX1rzU_9l7ETBiRYYi--XmKRNboiJkO6A_Aasm9o0rOgeNiUDyfHacwZROpWrElH5-l6jj-GVE1a1hzHG_tH9Evp7AjKAgQAnsa0MkD64DJIp3czWNN0OCSy7jQPA6Qow_ayKCdRPFLDb4WK7BFhu0 Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:29:01.507064 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8abd60d3224e4e2995d55417a73ffe58", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 563808cf212c40e2bd7f3ace5d1aec03 Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.508975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': 'b4f15d1b-c62f-4355-8af8-b7ae3474e0c0'} Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:29:01.510277 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. Aug 06 22:29:01.512098 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:01.513549 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Returning 404 to user: Instance b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:29:01.513549 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-a1c3abf2-d943-418f-a5e4-bf81f87621ed tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0" status: 404 len: 111 microversion: 2.1 time: 0.030809 Aug 06 22:29:01.513549 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 721/1417] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:01 2022] GET /compute/v2.1/servers/b4f15d1b-c62f-4355-8af8-b7ae3474e0c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:29:02.798129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:02.798623 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:02.805181 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:02.805658 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:02.806088 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:02.806769 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:02.807219 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:02.807640 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:02.820817 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] HTTP exception thrown: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Request method failure captured: Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: DELETE /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 HTTP/1.1 Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7umZhfQe35OgIv4uKKYLkBrgHgX1rzU_9l7ETBiRYYi--XmKRNboiJkO6A_Aasm9o0rOgeNiUDyfHacwZROpWrElH5-l6jj-GVE1a1hzHG_tH9Evp7AjKAgQAnsa0MkD64DJIp3czWNN0OCSy7jQPA6Qow_ayKCdRPFLDb4WK7BFhu0 Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:29:02.822344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8abd60d3224e4e2995d55417a73ffe58", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 563808cf212c40e2bd7f3ace5d1aec03 Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.824470 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': 'e4110040-c454-4dac-b519-30ef2b9e7c68'} Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:29:02.825444 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.826751 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.828207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Returning 404 to user: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:29:02.828207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-f0a2c217-05d5-4cc9-8ab1-541d1078a241 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 404 len: 111 microversion: 2.1 time: 0.029418 Aug 06 22:29:02.828207 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 697/1418] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:29:02 2022] DELETE /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:29:02.832034 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:02.832698 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] [instance: e4110040-c454-4dac-b519-30ef2b9e7c68] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:02.839632 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:02.844367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:02.844367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:02.844367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:02.844367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:02.845118 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:02.856772 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] HTTP exception thrown: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Request method failure captured: Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 HTTP/1.1 Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7umZhfQe35OgIv4uKKYLkBrgHgX1rzU_9l7ETBiRYYi--XmKRNboiJkO6A_Aasm9o0rOgeNiUDyfHacwZROpWrElH5-l6jj-GVE1a1hzHG_tH9Evp7AjKAgQAnsa0MkD64DJIp3czWNN0OCSy7jQPA6Qow_ayKCdRPFLDb4WK7BFhu0 Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:29:02.858270 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8abd60d3224e4e2995d55417a73ffe58", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8abd60d3224e4e2995d55417a73ffe58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 8abd60d3224e4e2995d55417a73ffe58 Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-982909518 Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 563808cf212c40e2bd7f3ace5d1aec03 Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-AttachVolumeTestJSON-982909518-project Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.860008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': 'e4110040-c454-4dac-b519-30ef2b9e7c68'} Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:29:02.861058 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. Aug 06 22:29:02.862613 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:29:02.864094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] Returning 404 to user: Instance e4110040-c454-4dac-b519-30ef2b9e7c68 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:29:02.864094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-b6b2a6a3-1c73-49ef-afe4-4b59c72187c1 tempest-AttachVolumeTestJSON-982909518 tempest-AttachVolumeTestJSON-982909518-project] 10.222.0.18 "GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68" status: 404 len: 111 microversion: 2.1 time: 0.031503 Aug 06 22:29:02.864094 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 722/1419] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:02 2022] GET /compute/v2.1/servers/e4110040-c454-4dac-b519-30ef2b9e7c68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:29:43.470388 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:43.470927 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:43.473073 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:29:43.473940 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG dbcounter [-] [118456] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:29:43.474079 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [req-b3e5f435-6c42-413f-9238-e10a0d795275 req-31a0ba2b-5688-4203-8ed1-77eb9861de14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c020c89-17d2-4bd3-acae-617ae1bd6407", "tag": "6e292602-2d21-4309-8de2-725f38b1e86e"}]} {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:29:43.478781 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:43.479506 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:43.479841 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:29:43.479974 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:43.480686 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:43.480814 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG dbcounter [-] [118457] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2 {{(pid=118457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:29:43.485369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:43.485369 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:43.486232 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b3e5f435-6c42-413f-9238-e10a0d795275 req-31a0ba2b-5688-4203-8ed1-77eb9861de14 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:43.486828 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b3e5f435-6c42-413f-9238-e10a0d795275 req-31a0ba2b-5688-4203-8ed1-77eb9861de14 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:43.487358 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [req-b3e5f435-6c42-413f-9238-e10a0d795275 req-31a0ba2b-5688-4203-8ed1-77eb9861de14 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:43.499379 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.compute.server_external_events [req-b3e5f435-6c42-413f-9238-e10a0d795275 req-31a0ba2b-5688-4203-8ed1-77eb9861de14 service nova] Creating event network-changed:6e292602-2d21-4309-8de2-725f38b1e86e for instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 on hv-cinder-84984 Aug 06 22:29:43.504810 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [req-b3e5f435-6c42-413f-9238-e10a0d795275 req-31a0ba2b-5688-4203-8ed1-77eb9861de14 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035234 Aug 06 22:29:43.505516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 723/1420] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:29:43.508344 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Going to try to terminate instance {{(pid=118456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:29:43.801763 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-b8361845-7794-4032-92b0-3f7cc4267e93 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 204 len: 0 microversion: 2.1 time: 0.335214 Aug 06 22:29:43.805649 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 698/1421] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:29:43 2022] DELETE /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:29:43.812758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:43.813197 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:43.821024 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:43.821508 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:43.821936 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:43.822624 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:43.823071 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:43.823488 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:43.962150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:43.970124 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4cf58bb3-f3f6-4a6e-93e4-316f0412d4fb tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1575 microversion: 2.1 time: 0.162657 Aug 06 22:29:43.970680 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 724/1422] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:43 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:44.992046 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:44.992888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:44.999643 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:45.000134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:45.000607 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:45.001306 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:45.001757 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:45.002178 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:45.142023 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:45.149774 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-1c9e7f09-c35c-40a2-8b2d-aadf848a4616 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1575 microversion: 2.1 time: 0.162353 Aug 06 22:29:45.150335 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 699/1423] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:44 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:46.171919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:46.172729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:46.178134 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-dc857be1-d66f-43a5-a505-6ff4a0978f35 req-0e943dda-0d1a-429f-b540-f6c48a6763f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c020c89-17d2-4bd3-acae-617ae1bd6407", "name": "network-vif-deleted", "tag": "6e292602-2d21-4309-8de2-725f38b1e86e"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:29:46.181191 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:46.181682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:46.182159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:46.183065 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:46.183719 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:46.184150 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:46.188651 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-dc857be1-d66f-43a5-a505-6ff4a0978f35 req-0e943dda-0d1a-429f-b540-f6c48a6763f0 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:46.194763 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-dc857be1-d66f-43a5-a505-6ff4a0978f35 req-0e943dda-0d1a-429f-b540-f6c48a6763f0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:46.194763 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-dc857be1-d66f-43a5-a505-6ff4a0978f35 req-0e943dda-0d1a-429f-b540-f6c48a6763f0 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:46.200674 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-dc857be1-d66f-43a5-a505-6ff4a0978f35 req-0e943dda-0d1a-429f-b540-f6c48a6763f0 service nova] Creating event network-vif-deleted:6e292602-2d21-4309-8de2-725f38b1e86e for instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 on hv-cinder-84984 Aug 06 22:29:46.205661 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-dc857be1-d66f-43a5-a505-6ff4a0978f35 req-0e943dda-0d1a-429f-b540-f6c48a6763f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031089 Aug 06 22:29:46.206263 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 700/1424] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:29:46.248423 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:46.256167 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-270ea154-8007-4c65-872f-e3b3b0aa00ee tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1389 microversion: 2.1 time: 0.088998 Aug 06 22:29:46.256754 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 725/1425] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:46 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:47.278389 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:47.279090 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:47.285300 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:47.285789 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:47.286227 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:47.286922 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:47.287377 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:47.287806 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:47.351737 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:47.363528 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6fc356d1-13f9-4d5b-80f1-f61efa4ce856 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1389 microversion: 2.1 time: 0.089898 Aug 06 22:29:47.364103 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 701/1426] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:47 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:48.386402 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:48.387013 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:48.393438 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:48.393910 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:48.394331 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:48.395008 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:48.395451 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:48.395864 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:48.460159 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:48.467629 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-85e59e9c-77cf-4dcd-85de-ac82159934d9 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1389 microversion: 2.1 time: 0.085269 Aug 06 22:29:48.468185 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 726/1427] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:48 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:49.488628 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:49.489319 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:49.495997 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:49.496505 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:49.496936 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:49.497616 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:49.498062 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:49.498478 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:49.559574 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:49.568388 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-5ffdbad2-5b8b-4565-bf64-94cd4e846251 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1222 microversion: 2.1 time: 0.083883 Aug 06 22:29:49.568978 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 702/1428] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:49 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:50.589193 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:50.589959 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:50.597449 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:50.601334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:50.601334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:50.601334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:50.601334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:50.601781 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:50.634178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:50.634178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:50.634178 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:50.634620 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.objects.instance [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lazy-loading 'fault' on Instance uuid 8c020c89-17d2-4bd3-acae-617ae1bd6407 {{(pid=118457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:29:50.674765 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:50.682866 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-4af621e6-7432-4eb3-95d4-e5cee255e168 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 200 len: 1227 microversion: 2.1 time: 0.097742 Aug 06 22:29:50.683427 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 727/1429] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:50 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 1227 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:51.704479 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:51.705041 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 8c020c89-17d2-4bd3-acae-617ae1bd6407] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:51.714561 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:51.715051 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:51.715488 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:51.716190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:51.716675 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:51.717110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:51.731129 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] HTTP exception thrown: Instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 could not be found. Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Request method failure captured: Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 HTTP/1.1 Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7uloKkHXbtRLKHNvoJdjwBgj2Ai-AZAwUKOBf92dXMaB4dovzNB3Q7sW1II9uXtw69WMvtOD0kOtvKs5nf9UMFf4gjiSsRHW8itN2_GXFnKWWJVmLGLtduuBhJKakifOBf9sGFI3PsjRTPwUyIDqd9KT7GXFCJVfbwDEhEupg8IAJaw Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:29:51.732767 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8168ba3e30a743a582d1c182ca2423b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-TestVolumeBootPattern-538900757 Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 2dae6a7ec4404626b75a6702386d091b Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 could not be found. Aug 06 22:29:51.734569 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '8c020c89-17d2-4bd3-acae-617ae1bd6407'} Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 could not be found. Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:29:51.735782 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 could not be found. Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 could not be found. Aug 06 22:29:51.737556 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:29:51.739147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Returning 404 to user: Instance 8c020c89-17d2-4bd3-acae-617ae1bd6407 could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:29:51.739147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-bd86c77f-8c9e-4564-b46d-02f09156b2ff tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407" status: 404 len: 111 microversion: 2.1 time: 0.033666 Aug 06 22:29:51.739147 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 703/1430] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:51 2022] GET /compute/v2.1/servers/8c020c89-17d2-4bd3-acae-617ae1bd6407 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:29:55.205989 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:55.206562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:55.207370 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-9a79e77f-d7fc-4b16-a81b-40afa3c697a7 req-6bc8b013-faf6-4201-a366-5e542c41364f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6e9d4b-2509-4926-9ce5-f9f47e711e65", "tag": "5d4efd18-f689-4073-bc55-c3a02f2a38e2"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:29:55.217532 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-9a79e77f-d7fc-4b16-a81b-40afa3c697a7 req-6bc8b013-faf6-4201-a366-5e542c41364f service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:55.218014 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-9a79e77f-d7fc-4b16-a81b-40afa3c697a7 req-6bc8b013-faf6-4201-a366-5e542c41364f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:55.218451 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-9a79e77f-d7fc-4b16-a81b-40afa3c697a7 req-6bc8b013-faf6-4201-a366-5e542c41364f service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:55.231872 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:55.231872 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:55.232385 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-9a79e77f-d7fc-4b16-a81b-40afa3c697a7 req-6bc8b013-faf6-4201-a366-5e542c41364f service nova] Creating event network-changed:5d4efd18-f689-4073-bc55-c3a02f2a38e2 for instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 on hv-cinder-84984 Aug 06 22:29:55.232514 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:55.234562 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:55.235182 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:55.235823 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:55.237973 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-9a79e77f-d7fc-4b16-a81b-40afa3c697a7 req-6bc8b013-faf6-4201-a366-5e542c41364f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034129 Aug 06 22:29:55.238760 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 704/1431] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:29:55.269975 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Going to try to terminate instance {{(pid=118457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:29:55.575747 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-ee6889d3-f5ef-4868-90e4-490da83b7f85 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 204 len: 0 microversion: 2.1 time: 0.373251 Aug 06 22:29:55.576732 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 728/1432] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:29:55 2022] DELETE /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:29:55.586483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:55.587318 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:55.595091 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:55.595587 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:55.596611 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:55.597456 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:55.598053 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:55.598483 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:55.745201 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:55.753348 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-6118c7d3-fde2-4bf1-ac2d-acc478418613 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1578 microversion: 2.1 time: 0.171538 Aug 06 22:29:55.754136 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 705/1433] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:55 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:56.776682 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:56.778005 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:56.784665 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:56.785297 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:56.787025 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:56.787733 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:56.788187 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:56.788700 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:56.927289 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:56.937758 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-45b79f3b-f5bf-4c39-8eff-261f0acd0261 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1578 microversion: 2.1 time: 0.166541 Aug 06 22:29:56.939020 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 729/1434] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:56 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:57.945819 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [req-ebab2a89-9916-48e0-91ba-3511008b9abf req-f6987fe5-9408-41fc-95cf-f908cceaa0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6e9d4b-2509-4926-9ce5-f9f47e711e65", "name": "network-vif-deleted", "tag": "5d4efd18-f689-4073-bc55-c3a02f2a38e2"}]} {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:29:57.957937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ebab2a89-9916-48e0-91ba-3511008b9abf req-f6987fe5-9408-41fc-95cf-f908cceaa0f6 service nova] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:57.957937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ebab2a89-9916-48e0-91ba-3511008b9abf req-f6987fe5-9408-41fc-95cf-f908cceaa0f6 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:57.957937 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [req-ebab2a89-9916-48e0-91ba-3511008b9abf req-f6987fe5-9408-41fc-95cf-f908cceaa0f6 service nova] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:57.960801 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:57.961674 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:57.968328 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:57.968955 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:57.969107 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.compute.server_external_events [req-ebab2a89-9916-48e0-91ba-3511008b9abf req-f6987fe5-9408-41fc-95cf-f908cceaa0f6 service nova] Creating event network-vif-deleted:5d4efd18-f689-4073-bc55-c3a02f2a38e2 for instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 on hv-cinder-84984 Aug 06 22:29:57.970516 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:57.971342 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:57.971903 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:57.972471 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:57.974441 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [req-ebab2a89-9916-48e0-91ba-3511008b9abf req-f6987fe5-9408-41fc-95cf-f908cceaa0f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033035 Aug 06 22:29:57.975199 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 706/1435] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Aug 6 22:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:29:58.037976 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.policy [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:58.045656 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-f0a524f6-9ba2-4457-9601-55caf5487d2c tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1392 microversion: 2.1 time: 0.090322 Aug 06 22:29:58.046217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 730/1436] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:57 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1392 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:29:59.068181 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:29:59.068851 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:29:59.076084 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:59.076619 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:59.077122 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:59.082072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:59.082072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:59.082072 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:59.110985 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:29:59.111460 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:29:59.111888 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:29:59.112326 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.objects.instance [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lazy-loading 'fault' on Instance uuid 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 {{(pid=118456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:29:59.154148 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.policy [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dae6a7ec4404626b75a6702386d091b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8168ba3e30a743a582d1c182ca2423b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:29:59.161552 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-8ff9ebc2-98bc-4ba5-b561-b4babf062437 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 200 len: 1230 microversion: 2.1 time: 0.097776 Aug 06 22:29:59.162105 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 707/1437] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:29:59 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:30:00.183493 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:30:00.184102 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 9b6e9d4b-2509-4926-9ce5-f9f47e711e65] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:30:00.190556 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:30:00.191051 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:30:00.191477 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:30:00.192168 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:30:00.192644 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:30:00.193070 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:30:00.206970 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] HTTP exception thrown: Instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 could not be found. Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Request method failure captured: Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 HTTP/1.1 Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7uloKkHXbtRLKHNvoJdjwBgj2Ai-AZAwUKOBf92dXMaB4dovzNB3Q7sW1II9uXtw69WMvtOD0kOtvKs5nf9UMFf4gjiSsRHW8itN2_GXFnKWWJVmLGLtduuBhJKakifOBf9sGFI3PsjRTPwUyIDqd9KT7GXFCJVfbwDEhEupg8IAJaw Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:30:00.208550 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8168ba3e30a743a582d1c182ca2423b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 2dae6a7ec4404626b75a6702386d091b Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 could not be found. Aug 06 22:30:00.210924 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '9b6e9d4b-2509-4926-9ce5-f9f47e711e65'} Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 could not be found. Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:30:00.211925 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 could not be found. Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 could not be found. Aug 06 22:30:00.213601 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.215048 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Returning 404 to user: Instance 9b6e9d4b-2509-4926-9ce5-f9f47e711e65 could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:30:00.215048 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-1af48987-23e3-4850-93ab-736a9f4641fc tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65" status: 404 len: 111 microversion: 2.1 time: 0.030724 Aug 06 22:30:00.215048 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 731/1438] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:30:00 2022] GET /compute/v2.1/servers/9b6e9d4b-2509-4926-9ce5-f9f47e711e65 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:30:00.719066 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:30:00.719835 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.compute.api [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:30:00.726328 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:30:00.726962 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:30:00.727405 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:30:00.728110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:30:00.728597 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:30:00.729024 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG oslo_concurrency.lockutils [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:30:00.742662 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.wsgi [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] HTTP exception thrown: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Request method failure captured: Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: request: DELETE /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed HTTP/1.1 Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept: application/json Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Accept-Encoding: identity Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Connection: close Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Length: 0 Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Content-Type: application/json Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Host: 10.222.0.18 Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Openstack-System-Scope: None Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: User-Agent: python-urllib3/1.26.11 Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Auth-Token: gAAAAABi7uloKkHXbtRLKHNvoJdjwBgj2Ai-AZAwUKOBf92dXMaB4dovzNB3Q7sW1II9uXtw69WMvtOD0kOtvKs5nf9UMFf4gjiSsRHW8itN2_GXFnKWWJVmLGLtduuBhJKakifOBf9sGFI3PsjRTPwUyIDqd9KT7GXFCJVfbwDEhEupg8IAJaw Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Id: None Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Domain-Name: None Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Identity-Status: Confirmed Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Is-Admin-Project: True Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Id: default Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Domain-Name: Default Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Project-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Role: reader,member Aug 06 22:30:00.744286 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Roles: reader,member Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8168ba3e30a743a582d1c182ca2423b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-Tenant-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Id: default Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Domain-Name: Default Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Id: 2dae6a7ec4404626b75a6702386d091b Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: X-User-Name: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: method: > Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: exception: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.746099 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: action_args: {'id': '6555e5ac-2ba8-4674-997b-e738b6ff64ed'} Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:30:00.747110 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.748485 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.750190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Returning 404 to user: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. {{(pid=118456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:30:00.750190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-3d814c69-650c-4543-a991-14cefca9215e tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 404 len: 111 microversion: 2.1 time: 0.030596 Aug 06 22:30:00.750190 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 708/1439] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Aug 6 22:30:00 2022] DELETE /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:30:00.754123 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '>' {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:30:00.754729 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.compute.api [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] [instance: 6555e5ac-2ba8-4674-997b-e738b6ff64ed] Fetching instance by UUID {{(pid=118457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:30:00.760734 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:30:00.761217 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:30:00.761654 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:30:00.762334 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Acquiring lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:30:00.762785 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:30:00.763208 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG oslo_concurrency.lockutils [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Lock "f6d95ae6-742b-4bf4-9987-f8ad7d260984" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:30:00.776659 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.wsgi [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] HTTP exception thrown: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Request method failure captured: Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: request: GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed HTTP/1.1 Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept: application/json Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Accept-Encoding: identity Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Connection: close Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Length: 0 Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Content-Type: application/json Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Host: 10.222.0.18 Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Openstack-System-Scope: None Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: User-Agent: python-urllib3/1.26.11 Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Auth-Token: gAAAAABi7uloKkHXbtRLKHNvoJdjwBgj2Ai-AZAwUKOBf92dXMaB4dovzNB3Q7sW1II9uXtw69WMvtOD0kOtvKs5nf9UMFf4gjiSsRHW8itN2_GXFnKWWJVmLGLtduuBhJKakifOBf9sGFI3PsjRTPwUyIDqd9KT7GXFCJVfbwDEhEupg8IAJaw Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Id: None Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Domain-Name: None Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Identity-Status: Confirmed Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Is-Admin-Project: True Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Id: default Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Domain-Name: Default Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Project-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Role: reader,member Aug 06 22:30:00.778148 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Roles: reader,member Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8168ba3e30a743a582d1c182ca2423b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8168ba3e30a743a582d1c182ca2423b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Id: 8168ba3e30a743a582d1c182ca2423b3 Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-Tenant-Name: tempest-TestVolumeBootPattern-538900757 Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Id: default Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Domain-Name: Default Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Id: 2dae6a7ec4404626b75a6702386d091b Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: X-User-Name: tempest-TestVolumeBootPattern-538900757-project Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: method: > Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: exception: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.779907 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: action_args: {'id': '6555e5ac-2ba8-4674-997b-e738b6ff64ed'} Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: {{(pid=118457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:30:00.780941 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. Aug 06 22:30:00.782561 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: ERROR nova.api.openstack.wsgi Aug 06 22:30:00.783919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: DEBUG nova.api.openstack.wsgi [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Returning 404 to user: Instance 6555e5ac-2ba8-4674-997b-e738b6ff64ed could not be found. {{(pid=118457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:30:00.783919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO nova.api.openstack.requestlog [None req-8e5530f6-26ef-4e0b-922a-6d2a542ce805 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed" status: 404 len: 111 microversion: 2.1 time: 0.029176 Aug 06 22:30:00.783919 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: [pid: 118457|app: 0|req: 732/1440] 10.222.0.18 () {58 vars in 1236 bytes} [Sat Aug 6 22:30:00 2022] GET /compute/v2.1/servers/6555e5ac-2ba8-4674-997b-e738b6ff64ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:30:02.277516 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: DEBUG nova.api.openstack.wsgi [None req-a126f7e2-9df0-4f86-9988-42e040e61565 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] Calling method '.version_select at 0x7f30cb1cb430>' {{(pid=118456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:30:02.351180 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO nova.api.openstack.requestlog [None req-a126f7e2-9df0-4f86-9988-42e040e61565 tempest-TestVolumeBootPattern-538900757 tempest-TestVolumeBootPattern-538900757-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-898913352" status: 202 len: 0 microversion: 2.1 time: 0.077402 Aug 06 22:30:02.351884 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: [pid: 118456|app: 0|req: 709/1441] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Aug 6 22:30:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-898913352 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:30:36.670086 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:30:36.671536 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Sat Aug 6 22:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:32:13.015991 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:32:13.016717 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:32:18.476236 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:32:18.476849 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:32:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:32:36.957127 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:32:36.957803 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:33:04.378195 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:33:04.378681 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Sat Aug 6 22:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:33:56.678447 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:33:56.679126 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Sat Aug 6 22:33:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:35:30.284427 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:35:30.285142 dv-cinder-849846-7-iscsi devstack@n-api.service[118456]: Sat Aug 6 22:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:35:33.024683 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:35:33.025266 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:35:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:35:38.484492 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:35:38.485125 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:35:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:35:56.965367 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:35:56.966175 dv-cinder-849846-7-iscsi devstack@n-api.service[118457]: Sat Aug 6 22:35:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!